-- Logs begin at Wed 2022-10-12 13:58:38 UTC, end at Wed 2022-10-12 14:40:15 UTC. -- Oct 12 14:25:20.225064 dv-cinder-812685-17-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 14:25:20.236233 dv-cinder-812685-17-smb devstack@keystone.service[81547]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 14:25:20 2022] *** Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: nodename: dv-cinder-812685-17-smb Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: machine: x86_64 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: clock source: unix Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: pcre jit disabled Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: detected number of CPU cores: 4 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: current working directory: / Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: detected binary path: /usr/bin/uwsgi-core Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: your processes number limit is 47680 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: your memory page size is 4096 bytes Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: detected max file descriptor number: 2048 Oct 12 14:25:20.236798 dv-cinder-812685-17-smb devstack@keystone.service[81547]: lock engine: pthread robust mutexes Oct 12 14:25:20.237474 dv-cinder-812685-17-smb devstack@keystone.service[81547]: thunder lock: enabled Oct 12 14:25:20.237474 dv-cinder-812685-17-smb devstack@keystone.service[81547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 14:25:20.237474 dv-cinder-812685-17-smb devstack@keystone.service[81547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 14:25:20.279851 dv-cinder-812685-17-smb devstack@keystone.service[81547]: Python main interpreter initialized at 0x56025daa09c0 Oct 12 14:25:20.279851 dv-cinder-812685-17-smb devstack@keystone.service[81547]: python threads support enabled Oct 12 14:25:20.279851 dv-cinder-812685-17-smb devstack@keystone.service[81547]: your server socket listen backlog is limited to 100 connections Oct 12 14:25:20.279851 dv-cinder-812685-17-smb devstack@keystone.service[81547]: your mercy for graceful operations on workers is 90 seconds Oct 12 14:25:20.280204 dv-cinder-812685-17-smb devstack@keystone.service[81547]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 14:25:20.280204 dv-cinder-812685-17-smb devstack@keystone.service[81547]: *** Operational MODE: preforking *** Oct 12 14:25:20.280476 dv-cinder-812685-17-smb devstack@keystone.service[81547]: *** uWSGI is running in multiple interpreter mode *** Oct 12 14:25:20.280476 dv-cinder-812685-17-smb devstack@keystone.service[81547]: spawned uWSGI master process (pid: 81547) Oct 12 14:25:20.280684 dv-cinder-812685-17-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 12 14:25:20.283698 dv-cinder-812685-17-smb devstack@keystone.service[81547]: spawned uWSGI worker 1 (pid: 81561, cores: 1) Oct 12 14:25:20.283698 dv-cinder-812685-17-smb devstack@keystone.service[81547]: spawned uWSGI worker 2 (pid: 81562, cores: 1) Oct 12 14:25:20.283698 dv-cinder-812685-17-smb devstack@keystone.service[81547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 14:25:24.555671 dv-cinder-812685-17-smb devstack@keystone.service[81561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 14:25:24.555671 dv-cinder-812685-17-smb devstack@keystone.service[81561]: from cryptography.utils import int_from_bytes Oct 12 14:25:24.556460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 14:25:24.556460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: from cryptography.utils import int_from_bytes Oct 12 14:25:24.556868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 14:25:24.556868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: from cryptography.utils import int_from_bytes Oct 12 14:25:24.556975 dv-cinder-812685-17-smb devstack@keystone.service[81562]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 14:25:24.556975 dv-cinder-812685-17-smb devstack@keystone.service[81562]: from cryptography.utils import int_from_bytes Oct 12 14:25:24.605983 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 14:25:24.606128 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 14:25:24.606238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 14:25:24.606327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 14:25:24.606404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] command line args: [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 14:25:24.606478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] command line args: [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 14:25:24.606629 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 14:25:24.606714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 14:25:24.606834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ================================================================================ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 14:25:24.607414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ================================================================================ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 14:25:24.607593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] admin_token = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.607668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] admin_token = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.607832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_dir = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.607922 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_dir = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608239 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] config_source = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608319 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] config_source = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] debug = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] debug = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608555 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.608960 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609396 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609642 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609861 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.609958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_config_append = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_config_append = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610137 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_dir = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610405 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_dir = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610512 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610799 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.610960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611780 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.611846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612094 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.612939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613646 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.613914 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614422 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] publish_errors = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] publish_errors = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.614901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615445 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615543 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.615905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] standard_threads = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616017 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] standard_threads = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616174 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616537 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616762 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.616880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_journal = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_journal = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617182 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_json = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_json = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617413 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_stderr = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617526 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_stderr = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] use_syslog = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] use_syslog = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.617990 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 14:25:24.618104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618491 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618828 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.618939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619052 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619171 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619396 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.619973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620679 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620792 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.620904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621015 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621247 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621592 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621705 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.621938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.622052 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.622197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.622316 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.622440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.623931 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624045 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624277 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.624986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625672 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.625919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.626888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627122 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627241 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627482 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627602 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627722 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.627948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628060 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628180 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628300 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628413 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628526 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628750 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.628939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629867 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.629979 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630091 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630223 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630353 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630469 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630814 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.630926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631276 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631388 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.631870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632109 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632319 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632528 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632641 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632761 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.632998 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633609 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.633965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634236 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634823 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.634943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635063 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635749 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.635984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636677 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.636901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637475 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.637927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638195 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638436 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.638899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639351 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.639931 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640353 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.640936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641059 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641175 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641797 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.641912 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.642996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643233 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643469 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643708 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.643974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.external = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.external = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644812 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.644934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.password = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645050 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.password = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] auth.token = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] auth.token = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645394 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.645986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.646943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647182 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647515 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647628 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647750 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.647981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648665 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.648894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649007 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649246 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649709 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.649954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650362 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.650952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.651887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652003 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652352 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652467 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652848 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.652966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653307 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653421 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653670 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.653899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.654910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655032 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655261 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655840 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.655960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656302 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656789 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.656904 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657609 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657847 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.657965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658480 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658722 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.658988 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659704 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.659939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660063 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660180 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660636 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.660988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661103 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.661798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662715 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.662944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663057 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663625 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663625 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.663952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664190 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664418 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.664977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665206 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.665902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.666967 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.667890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668118 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668353 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668684 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668798 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.668911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.669032 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.669147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.669261 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.669949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670069 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670463 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.670921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671159 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671273 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671617 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671861 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.671975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.672986 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.673924 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674152 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674287 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674764 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.674999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675235 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675351 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675465 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.675929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676159 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676386 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676499 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676737 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.676971 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.677971 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678087 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678805 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.678921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679149 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.679955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680077 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680194 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680308 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680422 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680649 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.680888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681003 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681003 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681219 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681467 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681467 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681797 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.681911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682147 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682537 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.682893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683585 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.683932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684169 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684399 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684512 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.684866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.685078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.685710 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.685825 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.685939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686194 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686313 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686427 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686666 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.686905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687477 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687598 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687828 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.687941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688055 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688406 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.688984 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689441 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689561 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689684 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.689933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690049 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690667 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.690905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691248 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.691946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692299 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692528 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692642 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.692884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693001 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693810 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.693991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694531 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81562) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 14:25:24.694981 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694981 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694981 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 14:25:24.694981 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 14:25:24.720892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.721121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.721221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.721346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.721430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.721601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.729586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.729986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.758437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.758624 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.758708 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.758852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.812639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.812766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.860865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.861095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.861839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:24.862071 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.015982 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.016368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.016509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.016645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.016881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.016987 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.017067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.017212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.017656 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.017884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.018115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.018568 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.041321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.041639 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.041896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042075 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.042776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.043032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.043508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.044330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.045287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.054096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.057885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.067419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.067622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.067837 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.068039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.068257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.068473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.068689 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81561) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.072274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.072610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.072771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.073067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.073382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.073818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.073933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81562) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 14:25:25.085915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.086130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 14:25:25.086271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.086482 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 14:25:25.086579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.086691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 14:25:25.086826 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.086966 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 14:25:25.087227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087748 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.087830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.088020 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.097417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.097593 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.097702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.097871 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.097979 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.098140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.098298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.098454 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.105306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.105398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.108757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.108847 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.109039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109600 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109882 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.109964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110436 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.110972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.111055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.111243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.111323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.111507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.111587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.134636 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.134733 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.136110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.136205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.136394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.136484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.141081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.141166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.141368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.141450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.141648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.141731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.148029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.148121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.148318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.148400 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.154232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.154368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.154530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.154661 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.154819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.154954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155389 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155526 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155667 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.155938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.156080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.156205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.156356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.172185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.172393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.172517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.172681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.176359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.176526 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.179595 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.179770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.179895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.180076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.184069 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.184296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.187229 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.187534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.190432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.190733 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.190816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191300 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.191941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.192132 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.208070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.208292 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.208376 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.208580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.208662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.208848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.208931 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.209113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.215742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.215950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.217346 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.217563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.218918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.219111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.219194 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.219391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.221875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.222162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.222295 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.222476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.222588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.222760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.222883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.223139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.223228 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.223525 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.234871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.235152 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.235236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.235433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.235514 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.235709 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.235791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.235987 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.236930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.252138 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.252305 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.255079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.255229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.257963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.258091 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.259536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.259625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.261018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.261145 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.261301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.261430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.261723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.261838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.268612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.268765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.270069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.270246 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.272949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.273916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.274074 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.281969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.282267 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.282365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.282554 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.282634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.282846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.289403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81562) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.289687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.289769 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81561) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 14:25:25.289969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290369 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.290920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291387 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291476 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.291930 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292556 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.292815 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.293004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.293083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81562) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.293282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81561) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 14:25:25.327777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56025daa09c0 pid: 81562 (default app) Oct 12 14:25:25.328219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56025daa09c0 pid: 81561 (default app) Oct 12 14:25:25.331182 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34798b-44c8-4ee3-84a3-4573e5603c3d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:25.331472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34798b-44c8-4ee3-84a3-4573e5603c3d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:25.331742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34798b-44c8-4ee3-84a3-4573e5603c3d None None] PATH_INFO: `/v3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:25.335886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Wed Oct 12 14:25:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:32.028299 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:32.028710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:32.028845 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:32.033143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:32.038185 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:32.038608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:32.038745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:32.109032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: INFO dbcounter [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] Registered counter for database keystone Oct 12 14:25:32.128017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG oslo_db.sqlalchemy.engines [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81562) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 14:25:32.134262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writer thread running {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 14:25:32.312579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG passlib.handlers.bcrypt [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81562) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 14:25:32.312884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG passlib.handlers.bcrypt [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81562) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 14:25:32.371828 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:32.373422 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:32.498437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 14:25:32.946779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:33.016702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: INFO dbcounter [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] Registered counter for database keystone Oct 12 14:25:33.038412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG oslo_db.sqlalchemy.engines [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 14:25:33.045136 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writer thread running {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 14:25:33.163436 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe3688-a5e1-454c-9a52-bc8a577ae035 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:33.167686 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:33.168398 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:33.168683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:33.168954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:33.176971 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:33.228373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 14:25:33.228663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa716-b250-4980-8d8c-dfd3dbb4ec56 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:33.238024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Oct 12 14:25:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 14:25:33.244062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:33.261062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695571cd-bf44-4098-a509-38930cb9e80c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:33.266076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:33.267200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:33.267483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:33.267752 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] PATH_INFO: `/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:33.269347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] RBAC: Authorizing `identity:get_project(project_id=12a7cca3f1ca479292dd1f33c68bdb7c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:33.322487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 14:25:33.322839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e5779-6739-46e2-b765-3aca63a3d0de admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:33.327907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:25:33 2022] GET /identity/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:35.429674 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b0eb-9d2d-45d8-8a27-1d3dc888442e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:35.430268 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b0eb-9d2d-45d8-8a27-1d3dc888442e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:35.430268 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94b0eb-9d2d-45d8-8a27-1d3dc888442e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:35.434814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:35.440164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:35.440547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:35.440717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:35.461319 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:35.462899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:35.470884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:25:35.740478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b0eb-9d2d-45d8-8a27-1d3dc888442e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:35.752547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94b0eb-9d2d-45d8-8a27-1d3dc888442e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:35.756759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:35.757356 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:35.757634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:35.757905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:35.765946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:35.767750 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98715f3d-6246-46d2-b17c-5bbb4d779eb4 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:35.776327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Oct 12 14:25:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 14:25:35.782258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:35.791268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fed2f-f43c-4bcf-b8f0-b91b7cc574ee None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:35.795668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:35.796293 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:35.796574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:35.796847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] PATH_INFO: `/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:35.798157 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] RBAC: Authorizing `identity:get_user(user_id=21c3be1e2cd1482e97fd97e6bb74d37f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:35.800019 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca5993-e4ed-4c61-85e7-d29894672368 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:35.801538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Wed Oct 12 14:25:35 2022] GET /identity/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:37.984954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a552-861f-4f3c-a3a1-7b5238e982f8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:37.985494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a552-861f-4f3c-a3a1-7b5238e982f8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:37.985494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6a552-861f-4f3c-a3a1-7b5238e982f8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:37.987019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:37.992388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:37.992823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:37.992909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.012374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:38.013535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:38.030395 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeeba5-6acd-4c5e-aab8-dece808a6ac0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.030679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeeba5-6acd-4c5e-aab8-dece808a6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.030948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeeba5-6acd-4c5e-aab8-dece808a6ac0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.032261 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:25:38.037109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.037393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.037667 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.079045 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG passlib.handlers.bcrypt [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81561) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 14:25:38.079434 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG passlib.handlers.bcrypt [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81561) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 14:25:38.095678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:25:38.128092 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:38.129675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:38.227195 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:25:38.363997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.388742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:38.471431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae307-8efa-4672-be4a-c8ec93086361 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.497644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.505309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.505955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.506262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.506539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.518384 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:38.527775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:38.528730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:25:38.529570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:25:38.534561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.595971 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bfe6b-6a34-4222-be01-10e6d13e61a8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.598958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:38.615508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:38.634550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.635422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.635554 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f18d6-b554-4e8b-8aa9-0d4a221c2c8e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.635701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.635965 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.637457 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:38.638916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:38.650098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.sql.core [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:25:38.650098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:25:38.650098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [parameters: {'id': 'd66cf50c97ed4cd8bc9c787a7b6c6c17', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 14:25:38.650098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:25:38.669827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 14:25:38.670842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application yield resource Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise self.value Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application session.commit() Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 14:25:38.671932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.flush() Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application compat.raise_( Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 14:25:38.673016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 14:25:38.674090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:25:38.675048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [parameters: {'id': 'd66cf50c97ed4cd8bc9c787a7b6c6c17', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 14:25:38.676038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:38.676953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.678391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 8/15] 10.222.0.27 () {60 vars in 1137 bytes} [Wed Oct 12 14:25:38 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:25:38.679328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.679328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.679328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.679328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.679732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:38.679732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:38.679732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:38.683769 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.688597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 8/16] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:38.694205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.783204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce4378-98bd-4d6c-bcd2-aa299a1d7b71 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.793341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4392d-e6d8-4c5d-96af-5805f06239bf None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.815504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.816350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.816627 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.816895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.826627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.827257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.827540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.827813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] PATH_INFO: `/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.828952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] RBAC: Authorizing `identity:get_user(user_id=21c3be1e2cd1482e97fd97e6bb74d37f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:38.830445 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:38.832014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:38.835170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:38.836729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:38.837500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.852062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:25:38.854741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:38.855650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:25:38.856471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:25:38.856471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:25:38.856471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:38.856471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:25:38.861473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.882722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:38.938526 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bcc3-fc87-40f8-8df8-fbddd89f269f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.962481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1bd94-db5e-4c67-8d80-3014248932d6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:38.972894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.973526 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.973807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.974078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.975236 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:38.976692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:38.978281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:38.986315 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:38.996550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:38.997167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:38.997447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:38.997734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:38.998392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:38.998694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:39.000072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a961f-cb6f-435d-8c6a-e9130400d39e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:39.017495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:39.069571 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:39.090333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73392ef1-89b1-4451-aa24-6851fe26f2dd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:39.125911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:39.126628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:39.126908 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:39.127180 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] PATH_INFO: `/v3/domains/default/users/21c3be1e2cd1482e97fd97e6bb74d37f/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:39.129133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=21c3be1e2cd1482e97fd97e6bb74d37f, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:39.130636 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b5935-064a-4bc7-8c72-a089dfb03573 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:39.245815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 11/21] 10.222.0.27 () {58 vars in 1361 bytes} [Wed Oct 12 14:25:38 2022] PUT /identity/v3/domains/default/users/21c3be1e2cd1482e97fd97e6bb74d37f/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:25:41.662357 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac2269-8206-49ca-958c-61c64bb8aa3d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.662867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac2269-8206-49ca-958c-61c64bb8aa3d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.662941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac2269-8206-49ca-958c-61c64bb8aa3d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.666491 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c299f0-66fa-4b1f-9aa8-cf172ae6f1b8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.668012 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c299f0-66fa-4b1f-9aa8-cf172ae6f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.668493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c299f0-66fa-4b1f-9aa8-cf172ae6f1b8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.673702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:41.675444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 11/23] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:41.677059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.677569 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.683747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.688171 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281731e-b5c3-4156-8755-5c4a6a2bb5b4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.688688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281731e-b5c3-4156-8755-5c4a6a2bb5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.689535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281731e-b5c3-4156-8755-5c4a6a2bb5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.731296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:41.731510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6281731e-b5c3-4156-8755-5c4a6a2bb5b4 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:41.732946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:41.733050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6281731e-b5c3-4156-8755-5c4a6a2bb5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:41.898334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 13/24] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:41.899406 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360e9b-11fe-484f-8aac-876727c3937a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.899692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360e9b-11fe-484f-8aac-876727c3937a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.899966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d360e9b-11fe-484f-8aac-876727c3937a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.901508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 14/25] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:41.908707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 12/26] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:41.911487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:41.911775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:41.912050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:41.947241 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:41.948493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:42.050490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:42.055167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 15/27] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:42.298916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:42.315999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:42.402029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:42.452550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732d4eb-bd6d-402b-b8bd-f6d29897a988 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:42.522880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:42.523517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:42.523785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:42.524060 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:42.524742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:42.532343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:42.576605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22463d34-2afe-4dc2-ad78-1928aaf2dfaf None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:42.613660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:42.614671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:42.615167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:42.615627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:42.626647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:42.628469 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3047c6c3-de06-4707-81e0-b39c1bceb78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:25:42.645093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:42.645977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:25:42.646822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:25:42.646822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:25:42.646822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:25:42.648890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 16/28] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:25:42.650291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45308b-56ae-44ce-af2f-2bafb042c014 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:42.650778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45308b-56ae-44ce-af2f-2bafb042c014 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:42.651582 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45308b-56ae-44ce-af2f-2bafb042c014 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:42.653065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 17/29] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:42.654296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45308b-56ae-44ce-af2f-2bafb042c014 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:42.690408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 13/30] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 12 14:25:42 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:42.691593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:42.718648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:42.771544 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45308b-56ae-44ce-af2f-2bafb042c014 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:42.811252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:42.812284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:42.812838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:42.813366 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:42.825977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-529b49ba-2dc1-4ee3-b0ce-ee4bd4a004d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:42.832403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:42.833255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:42.834007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:25:42.836860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 18/31] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:25:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:42.838516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:42.839560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:42.840024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:42.859602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:42.861318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:42.924049 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:42.941890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 19/32] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:42.943521 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:42.998642 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.018845 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae90d04-3906-4d17-9690-f2e128c9c147 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.056473 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2af3a-0cf6-49c3-b6e9-da75050995e2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.084478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.085033 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.085330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.085605 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.086293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:43.086599 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.088445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcda04-a8cd-48c4-bd5d-1aea27afd3df None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.097742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.098873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.099356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.099823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.100762 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:43.101560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.103356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.105207 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 14/33] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:43.112015 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e7ba-d248-4ab3-b86a-c67ed26affc8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.112332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e7ba-d248-4ab3-b86a-c67ed26affc8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.112576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021e7ba-d248-4ab3-b86a-c67ed26affc8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.115098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 20/34] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:43.116255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.118558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 15/35] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:43 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:43.121530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.121530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.121727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.141420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:43.142962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:43.227254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 16/36] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:43.228393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.231716 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221aaee3-b9e0-4b14-b5bf-99ecfca7ca94 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.234542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.271613 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.272447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.272824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.273197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.273987 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.276023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63722d-cb81-4879-8359-65e4d0c21163 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.296575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.312608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 21/37] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/projects => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:43.314023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6609bd-d9be-47cd-a641-8ed1f92581a4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.314699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6609bd-d9be-47cd-a641-8ed1f92581a4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.314967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6609bd-d9be-47cd-a641-8ed1f92581a4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.316356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 22/38] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:43.317466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6609bd-d9be-47cd-a641-8ed1f92581a4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.344717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de819aa-a6ef-4227-a140-9746c70c775a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.386550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.387589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.388051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.388498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] PATH_INFO: `/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.390404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] RBAC: Authorizing `identity:get_user(user_id=21c3be1e2cd1482e97fd97e6bb74d37f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.392183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993ddd0-378b-4ed7-9342-6ab3892c4f37 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.394255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 17/39] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:43 2022] GET /identity/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:43.395963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.396446 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.396898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.418342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:43.419937 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:43.499746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 18/40] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:43.501108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.559080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6609bd-d9be-47cd-a641-8ed1f92581a4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.565379 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.605713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.606558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.606846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.607126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.608263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.609961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.614657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6ef18-286d-4ca4-93cd-e1d353440afa None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.631133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/roles => generated 225 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:43.634287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.666474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.668644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.669331 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.669691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.670116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.671427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.673645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.675781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 19/42] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:43.682923 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.790268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d64af5-74d3-480c-8b29-2495b36396d1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.815155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ceeb-8acd-4166-8408-263847fed3e2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.830615 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.831400 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.831692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.832530 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.833113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.834640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.838210 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 24/43] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:43.838210 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.845078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.858317 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:43.858873 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:43.859157 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:43.859433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:43.860170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.domain.id=default, user.id=21c3be1e2cd1482e97fd97e6bb74d37f) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:43.860481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:43.861929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:43.872930 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 20/44] 10.222.0.27 () {56 vars in 1322 bytes} [Wed Oct 12 14:25:43 2022] GET /identity/v3/role_assignments?user.id=21c3be1e2cd1482e97fd97e6bb74d37f&scope.domain.id=default&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 530 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:43.873734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:43.943586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:43.964105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc557-3db2-45be-970a-aa5d6cabbfff None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:43.997628 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c0c05-5aac-42c6-a964-f78319085d8e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:44.010281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:44.011464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:44.011752 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:44.012034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:44.012969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:44.014574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84e1a-e594-446d-b248-9c9297883ea5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:44.032883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 25/45] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:44.036899 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:44.037544 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:44.037827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:44.038103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:44.038809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:44.040319 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdb9b2-6c2a-45ff-8d1d-32a3b3da42e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:44.075490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 21/46] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:25:43 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:46.219821 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ebc4-c451-4238-bac5-31c11a08e465 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:46.220322 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ebc4-c451-4238-bac5-31c11a08e465 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:46.220403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28ebc4-c451-4238-bac5-31c11a08e465 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:46.221692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 26/47] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:46.226853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:46.227216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:46.227408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:46.245975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:46.247120 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:46.281312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:46.311942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 22/48] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:46.581655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ebc4-c451-4238-bac5-31c11a08e465 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:46.681136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc28ebc4-c451-4238-bac5-31c11a08e465 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:46.712965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:46.714121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:46.714436 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:46.714714 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:46.715819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:46.717295 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93961c21-dde3-4475-92ff-0e521ee22632 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:46.718868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 27/49] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:46.724237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:46.817950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f0cf1-5f98-4be7-922b-a5fe8009f8b0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:46.850200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:46.850745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:46.851024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:46.851296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:46.851937 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:46.853364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f374b-6597-4014-860f-102a0463e6d0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:46.878694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 23/50] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Oct 12 14:25:46 2022] POST /identity/v3/projects => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:49.001016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d253-e1f7-4386-84ce-2d2d68473716 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:49.001393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d253-e1f7-4386-84ce-2d2d68473716 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:49.001573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d253-e1f7-4386-84ce-2d2d68473716 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:49.002966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 28/51] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:49.008185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:49.008549 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:49.008775 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:49.027534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:49.028725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:49.045415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:49.094104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:49.366537 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1d253-e1f7-4386-84ce-2d2d68473716 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:49.381581 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:49.467678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1d253-e1f7-4386-84ce-2d2d68473716 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:49.499857 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:49.500479 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:49.500763 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:49.501043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:49.502151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:49.503644 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef450c5-4abd-4028-b8c8-3c963f28acb0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:49.505189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:49.511157 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:49.606923 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccbfbd-d8c2-4575-bd05-20ede5024a14 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:49.639078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:49.639612 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:49.639895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:49.640164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:49.640789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:49.642240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b3962-823a-4dcc-af06-1f97aed67159 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:49.771516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 25/54] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:25:49 2022] POST /identity/v3/users => generated 275 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:25:52.930459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff51b-66f1-4351-a830-9641071e0e70 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:52.931569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff51b-66f1-4351-a830-9641071e0e70 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:52.932053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ff51b-66f1-4351-a830-9641071e0e70 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:52.933662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 30/55] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:52.939368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3545a-54ee-4cc5-ab30-74172669d89d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:52.939832 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3545a-54ee-4cc5-ab30-74172669d89d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:52.939901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3545a-54ee-4cc5-ab30-74172669d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:52.959278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-eeb3545a-54ee-4cc5-ab30-74172669d89d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:52.960495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-eeb3545a-54ee-4cc5-ab30-74172669d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:52.965921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.050954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f503ae-1c14-4366-9dba-e6927bc78aff None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.051694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f503ae-1c14-4366-9dba-e6927bc78aff None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.052164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f503ae-1c14-4366-9dba-e6927bc78aff None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.053755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 31/56] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:53.056504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 26/57] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:53.059201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.059715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.060204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.079968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:53.081498 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:53.128689 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31117-7809-4e2f-998c-a99b594e969c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.129009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31117-7809-4e2f-998c-a99b594e969c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.129280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31117-7809-4e2f-998c-a99b594e969c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.130675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:53.143611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.143889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.144162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.163199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:53.164671 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:53.187778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:53.243424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 28/60] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:53.361326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.374770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.473434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870ccb1-ed2a-47b8-b767-66efe152e1b0 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:53.482144 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.539594 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:53.540900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.542195 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.542937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.566411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:53.577851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:53.578793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:53.579557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:25:53.582811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 33/61] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:53.588503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.602451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.642630 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4dd8e-356f-4e27-9c30-78b5a4b599b0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:53.669759 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.684881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:53.685689 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.685974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.686285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.698335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:53.702886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83723b0-4912-41d1-8bb1-224c3f9fa2be None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:53.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:53.705571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:53.706367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 29/62] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:25:53.707663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.742231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:53.742777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.743060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.743365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.744033 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:53.744335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:53.745720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7e63-0748-4c68-8443-6fc50287a243 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:53.753910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 34/63] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:53.755429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381b46-fd3a-40a8-be54-bf650f190671 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.755717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381b46-fd3a-40a8-be54-bf650f190671 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.755993 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381b46-fd3a-40a8-be54-bf650f190671 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.762063 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 35/64] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:53.762063 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381b46-fd3a-40a8-be54-bf650f190671 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.818865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62b3d2-e086-4e15-a6c7-f35aaf1e3988 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:53.847729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.854740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:53.855611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.856194 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.856534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.867804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:53.868824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381b46-fd3a-40a8-be54-bf650f190671 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:53.873699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:53.874768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:53.875527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 30/65] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:53.876152 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:53.903343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:53.909308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:53.909926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.910234 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.910519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.911216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:53.911506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:53.912897 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e081073-2cce-4897-9283-fb8d6a65cc76 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:53.922303 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 36/66] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:53.928098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:53.928389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:53.928669 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:53.948589 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:53.949822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:53.995566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0fbd-3d51-4ece-a803-23302c2c24ce None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.023518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 37/67] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:54.025505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.046114 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.047845 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.048653 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.049206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.067546 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.069101 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.070793 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 31/68] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:53 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.075029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.130935 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.131443 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004959a9-0a25-4d7c-a844-8388fd5468f9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.159163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.170704 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.171323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.171601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.171871 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.172533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:54.172833 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.174249 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b364-88bc-48da-bc9c-1a203c3aed66 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.183056 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 38/69] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.183989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0dfb2-9064-4c90-be80-48515b6b4735 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.184274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0dfb2-9064-4c90-be80-48515b6b4735 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.184547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0dfb2-9064-4c90-be80-48515b6b4735 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.185890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 39/70] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:54.186337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d667620-1021-4740-9c9c-51b7bbf3cfbb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.190444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0dfb2-9064-4c90-be80-48515b6b4735 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.221803 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.222479 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.222761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.223036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] PATH_INFO: `/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.224240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] RBAC: Authorizing `identity:get_user(user_id=21c3be1e2cd1482e97fd97e6bb74d37f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.225700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.227315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 32/71] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.228140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.301583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0dfb2-9064-4c90-be80-48515b6b4735 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.331185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15bff4-9939-49e4-a252-1387610627af None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.335940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.336564 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.336841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.337224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.338520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.339992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63336-b45d-4893-b909-9c7d1d24b6b5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.341645 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 40/72] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.342791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.343074 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.343347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.347295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.361166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:54.362401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:54.365373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.366007 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.366327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.366598 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.368008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.369485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.371088 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 33/73] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.371835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.413693 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.433024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 41/74] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:54.433851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.477203 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d02c-b37b-47d9-8edc-2a7f6a6d70ae None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.513212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.513845 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.514127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.514429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.515637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.517001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.523545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 34/75] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.523545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.549980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2def1d-f4e2-4425-9782-bcad3529153f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.577732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.589333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.590205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.590657 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.591125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.601890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:54.607490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:54.608325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:54.609058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:25:54.611039 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 42/76] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:54.611952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.634531 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0caee-8c46-4472-a1c3-7f2715f05813 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.660176 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.672616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.673441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.673727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.674002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/1989eb27cf724db5bbe686d58d292980/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.676093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, user_id=1989eb27cf724db5bbe686d58d292980, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.677454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.692533 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 35/77] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:25:54 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/1989eb27cf724db5bbe686d58d292980/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:25:54.693587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.728577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0e6a0-e573-4741-b64f-5cb5f62cd54c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.766548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.767205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.767485 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.767761 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.768969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.770492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.772660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 43/78] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.772660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.823051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1ba5c-a102-4fd1-9c10-7c45bbd12e7a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.839311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.863351 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.864039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.864325 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.864601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/21c3be1e2cd1482e97fd97e6bb74d37f/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.866645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, user_id=21c3be1e2cd1482e97fd97e6bb74d37f, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.869325 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.888979 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 36/79] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:25:54 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/21c3be1e2cd1482e97fd97e6bb74d37f/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:25:54.889817 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:54.901841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f592d18-8019-4518-bb55-b6e961c0b37f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:54.918725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:54.943548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:54.944232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:54.944540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:54.945004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:54.945487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:54.945796 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:54.947328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:54.957154 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 44/80] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:54.957811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:55.017035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e36f9-c838-4cd5-a97a-e97071f472e2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.057683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.058467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.058751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.059027 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.060276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.061900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.063724 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 37/81] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:55.064777 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:55.101238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960337-4ecd-48c5-abd4-a051a1b6d9cb None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.119659 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:55.145161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.145847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.146130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.146437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/1989eb27cf724db5bbe686d58d292980/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.148941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, user_id=1989eb27cf724db5bbe686d58d292980, role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.151633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.174166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 45/82] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:25:54 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/1989eb27cf724db5bbe686d58d292980/roles/e7fae3c65ae44410ade680c055bb291f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:25:55.175018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:55.197918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358682ea-42c9-4357-8d73-475676f3da28 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.224395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:55.261727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.266920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.267215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.267432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.270306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.272796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.276333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 38/83] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:55 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:55.282696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:55.371758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc4731-a892-41df-9174-d77cc54f1d61 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.411388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.412016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.412298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.412577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.413240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.414757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.433177 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7773-2016-4bca-914e-3f850982b25d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.442938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:55.444920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 46/84] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:25:55 2022] POST /identity/v3/users => generated 289 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:25:55.473616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.474321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.474663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.474946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] PATH_INFO: `/v3/projects/664adab184c14cfba1ea1b0f0646d694` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.476333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] RBAC: Authorizing `identity:get_project(project_id=664adab184c14cfba1ea1b0f0646d694)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.478400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15dbc8-b0b2-4a8d-b9d0-cfeea9301715 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.480168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 39/85] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:55 2022] GET /identity/v3/projects/664adab184c14cfba1ea1b0f0646d694 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:55.486320 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:55.606006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:55.617614 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba997e-369a-4a0d-bf33-fd8c766d1614 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:55.667471 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:55.668075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:55.668354 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:55.668631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] PATH_INFO: `/v3/projects/664adab184c14cfba1ea1b0f0646d694/users/1989eb27cf724db5bbe686d58d292980/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:55.670648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=664adab184c14cfba1ea1b0f0646d694, user_id=1989eb27cf724db5bbe686d58d292980, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:55.672209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf041121-67a8-433f-ba06-304ba0a539d5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:55.697151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 47/86] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:25:55 2022] PUT /identity/v3/projects/664adab184c14cfba1ea1b0f0646d694/users/1989eb27cf724db5bbe686d58d292980/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:25:57.394975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22059-3421-4fa4-ada5-32c7cb8cecdd None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:57.395458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22059-3421-4fa4-ada5-32c7cb8cecdd None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:57.395458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22059-3421-4fa4-ada5-32c7cb8cecdd None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:57.396929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 40/87] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:57.402831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd804ab-ec3c-4426-b9d0-1eddda7a1953 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:57.403303 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd804ab-ec3c-4426-b9d0-1eddda7a1953 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:57.403373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd804ab-ec3c-4426-b9d0-1eddda7a1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:57.422271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9bd804ab-ec3c-4426-b9d0-1eddda7a1953 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:57.423471 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9bd804ab-ec3c-4426-b9d0-1eddda7a1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:57.494415 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 48/88] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:57.563283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069505a9-8b2f-490b-87b2-71a61fceb18d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:57.563609 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069505a9-8b2f-490b-87b2-71a61fceb18d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:57.563843 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069505a9-8b2f-490b-87b2-71a61fceb18d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:57.565222 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 41/89] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:57.571633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3725947-0755-465e-b003-033d74edd94d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:57.571926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3725947-0755-465e-b003-033d74edd94d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:57.572205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3725947-0755-465e-b003-033d74edd94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:57.594298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e3725947-0755-465e-b003-033d74edd94d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:57.595495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e3725947-0755-465e-b003-033d74edd94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:57.677753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 49/90] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:57.823198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069505a9-8b2f-490b-87b2-71a61fceb18d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:57.938124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069505a9-8b2f-490b-87b2-71a61fceb18d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:57.989049 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:57.990054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:57.990548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:57.991008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.006980 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5c184d82-7c07-4241-8793-9d3a595f0bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:58.012412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:58.013257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:58.014026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 42/91] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:58.019299 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3725947-0755-465e-b003-033d74edd94d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:58.037412 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:58.145101 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3725947-0755-465e-b003-033d74edd94d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:58.148458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4992-77c2-41f6-909c-ab984a707528 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.148774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4992-77c2-41f6-909c-ab984a707528 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.149390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4992-77c2-41f6-909c-ab984a707528 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.151025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 43/92] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:58.161905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.162207 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.162648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.191278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:58.192390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:58.197403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:58.198027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.198335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.198607 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.200129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:58.200442 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:58.201848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:58.216498 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 50/93] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:58.222419 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:58.261024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:58.317863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:58.354480 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65bf98-c906-4cb4-911c-14a5c8f26597 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:58.355496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 44/94] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:58.356363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:58.432026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:58.432805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.433222 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.434498 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.439603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:58.441143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:58.442865 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 51/95] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:25:58.448410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:58.555809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853ca3-53a2-4a28-aecc-56032644f74b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:58.625532 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:58.626606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.627105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.627652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.645980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd35-8c20-4660-a2c2-60c8e191561f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:58.654525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:58.659716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:58.660550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:25:58.661345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:58.663605 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 45/96] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:58.669723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:58.719880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:58.720452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.720738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.721018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.728181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:58.750564 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:58.849309 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d680c62-a79e-4344-be79-8f92d1c2f838 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:58.882249 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:58.884739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96d19-8529-4573-8977-90790f8190d0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:58.892265 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:58.892966 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:58.893343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:58.894704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:58.895654 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:58.906214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:58.906214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:58.928632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:58.929695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.015736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 52/98] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 14:25:59.017243 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2bea-1094-4490-a799-328263a3d37f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.017529 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2bea-1094-4490-a799-328263a3d37f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.017805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e2bea-1094-4490-a799-328263a3d37f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.024231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 53/99] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:59.025258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e2bea-1094-4490-a799-328263a3d37f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.082641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.119721 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.142348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b1f0a-3b6a-4ed2-8972-c7a0889bf33a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.145689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e2bea-1094-4490-a799-328263a3d37f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.182548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.183192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.183472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.183746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] PATH_INFO: `/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.184977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] RBAC: Authorizing `identity:get_user(user_id=21c3be1e2cd1482e97fd97e6bb74d37f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.186609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.188415 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 54/100] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/users/21c3be1e2cd1482e97fd97e6bb74d37f => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.190840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.191483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.192296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.193155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.193439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.205675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-60dbf9ae-f88c-4deb-b8cf-8222c90af02a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:25:59.211399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:25:59.212243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:25:59.213018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 47/101] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:25:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:25:59.213648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e648a2-d2f0-4fc7-9bb0-2a90ff3269c1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.214440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e648a2-d2f0-4fc7-9bb0-2a90ff3269c1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.214440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e648a2-d2f0-4fc7-9bb0-2a90ff3269c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.233875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-39e648a2-d2f0-4fc7-9bb0-2a90ff3269c1 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:59.235106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-39e648a2-d2f0-4fc7-9bb0-2a90ff3269c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:59.309451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 48/102] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:59.310663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a2fd-5102-416d-808f-d25935d025ba None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.310952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a2fd-5102-416d-808f-d25935d025ba None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.311234 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647a2fd-5102-416d-808f-d25935d025ba None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.312627 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 49/103] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:59.317186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a2fd-5102-416d-808f-d25935d025ba None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.333484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c05e-35b3-4508-9e3e-6b1b5a1b08a7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.345703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.374863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.376023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.376576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.377121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.378632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.380483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.382885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 55/104] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.383967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.398419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.423174 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647a2fd-5102-416d-808f-d25935d025ba None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.460154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.460764 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.461577 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.461859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.504255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e7e9-2f4d-4b16-ba5f-04b228fb137d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.531801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.533213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.542659 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.543317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.543606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.543885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.544577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:59.544850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.546256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d3e6d-6f1f-4371-9ea0-564229f25a26 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.558328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 56/105] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.558328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ff9-191d-42c0-a3d1-0b45e3aef98d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.558328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ff9-191d-42c0-a3d1-0b45e3aef98d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.558328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9587ff9-191d-42c0-a3d1-0b45e3aef98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.575715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e9587ff9-191d-42c0-a3d1-0b45e3aef98d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:25:59.576822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e9587ff9-191d-42c0-a3d1-0b45e3aef98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:25:59.606337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.614380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.636503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 50/106] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:25:59.637318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.646468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 57/107] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:25:59.647706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48cfa-1625-4d63-b588-4b11a86d7f23 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.647993 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48cfa-1625-4d63-b588-4b11a86d7f23 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.648271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f48cfa-1625-4d63-b588-4b11a86d7f23 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.649805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 58/108] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:25:59.650524 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f48cfa-1625-4d63-b588-4b11a86d7f23 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.752487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f48cfa-1625-4d63-b588-4b11a86d7f23 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.753255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5308f5-74f0-4aa0-aa59-7b364219c99f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.787094 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.787723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.788005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.788281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.789911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.790532 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.791143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.791394 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.791492 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.791677 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.792394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] RBAC: Adding query filter params (role.id=0758c64a8e384ccda9eb5443f4a87c6b, scope.project.id=ada28e826b664a92bc196ccac52c6a32, user.id=1989eb27cf724db5bbe686d58d292980) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:25:59.792761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.792969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 59/109] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.793727 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.799713 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.806961 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 51/110] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/role_assignments?user.id=1989eb27cf724db5bbe686d58d292980&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.811111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:25:59.848355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.872833 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:25:59.940197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea3884-c4b3-437d-848f-90d8ed58f2af None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.941630 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c359e7-aff8-4d1a-b1d2-dc50676d8ca3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:25:59.980167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.980430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:25:59.981129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.981372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.981593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.981933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.982051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.982477 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.984036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:25:59.985603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f1eb7-d8a0-48c7-b007-1fece18942b6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:25:59.987435 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 52/111] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:25:59.988670 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:25:59.989074 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:25:59.989441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:25:59.997987 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:00.003067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:00.003911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:00.004746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 60/112] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:25:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:00.005364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.013455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:00.015107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:00.090262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 53/113] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:00.091195 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.113792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.119552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95955b-efcd-46ca-9195-68a30a7de744 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.137441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.155005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.155616 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.155902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.156165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.199188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f15c2e-3a89-4a9d-87e0-1b6c19c7f9da None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.230141 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.231738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.235381 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.236012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.236295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.236569 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.248540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:00.253333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:00.254197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:00.254997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 54/114] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:00.255630 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.336507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.345087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 61/115] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:00.345087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.361402 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.364949 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3129-4ca0-4454-9d87-fd6fb7d13e93 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.399310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.399914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.400197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.400471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.401190 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=ada28e826b664a92bc196ccac52c6a32, user.id=21c3be1e2cd1482e97fd97e6bb74d37f) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:00.401501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.402987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.408537 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 55/116] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/role_assignments?user.id=21c3be1e2cd1482e97fd97e6bb74d37f&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.409308 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.462516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5310d8-2749-4de0-8175-a72b7aa42bd7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.501433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.502067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.502380 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.502657 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.503337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:00.503641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.505041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.515434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 62/117] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.516321 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.545880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4a4ec-0f15-4bfa-988b-566d36dbd3a6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.583729 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.587781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.588401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.588680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.588954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.589678 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:00.589991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.591404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.601401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 56/118] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.602085 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.631709 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645f320-721a-444f-b3bb-69e7def2cc46 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.638070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.668143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.668779 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.669062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.669339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.670488 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.671935 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.673565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 63/119] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.674348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.714043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278da83-e5db-488b-9c3f-dcf2f96bac85 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.746337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.746970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.747255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.747534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.748639 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.750085 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.751684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 57/120] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.752442 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.772846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c3c7-21e2-4e9d-b4fd-c17804f9e250 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.797115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.806660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.807287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.807566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.807839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] PATH_INFO: `/v3/users/1989eb27cf724db5bbe686d58d292980` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.808955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] RBAC: Authorizing `identity:get_user(user_id=1989eb27cf724db5bbe686d58d292980)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.810446 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.812001 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 64/121] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/users/1989eb27cf724db5bbe686d58d292980 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.814966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.847085 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:00.854274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909581a4-3206-4ca2-905e-e847d96ac8c6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.888106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.888664 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.888944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.889211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] PATH_INFO: `/v3/users/ef58df92e4e84498bc7339031d2dd1e3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.902393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=ef58df92e4e84498bc7339031d2dd1e3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.903851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.905438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 58/122] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/users/ef58df92e4e84498bc7339031d2dd1e3 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.906198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:00.915927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720166f-3e63-447f-b624-62de11b11080 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:00.949345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:00.949951 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:00.950266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:00.950544 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:00.951269 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] RBAC: Adding query filter params (role.id=e7fae3c65ae44410ade680c055bb291f, scope.project.id=ada28e826b664a92bc196ccac52c6a32, user.id=1989eb27cf724db5bbe686d58d292980) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:00.951586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:00.953042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:00.960015 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 65/123] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/role_assignments?user.id=1989eb27cf724db5bbe686d58d292980&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=e7fae3c65ae44410ade680c055bb291f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:00.960816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:01.029682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:01.032378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e6e28-d97f-486a-ae7b-54ab42ef2ca7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.073869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.074816 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.075249 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.075529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.076186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.077625 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e42920-9871-4647-9382-67d253c165d5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.077761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.109119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 59/124] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:26:00 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:01.109988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:01.120193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:01.130899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.131553 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.131839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.132117 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.238580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.240840 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.265484 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c864c-a071-4b81-aa47-e4f7dd120ab3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.306004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.306926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.307208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.307480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.308147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:01.308614 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.310134 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.312010 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 60/125] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:01 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:01.318502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:01.359658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 66/126] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:01.365732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:01.399229 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:01.432797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d073f6-b386-4e39-9250-19b57a59a9b1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.470666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.471641 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.471925 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.472211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/ef58df92e4e84498bc7339031d2dd1e3/roles/dc2ff8de43f043c1b4d5f9416fefe45e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.474148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, user_id=ef58df92e4e84498bc7339031d2dd1e3, role_id=dc2ff8de43f043c1b4d5f9416fefe45e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.475634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.480688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ee04d-c82f-4cb9-b29b-19177cab1a63 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.489659 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 61/127] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:01 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/users/ef58df92e4e84498bc7339031d2dd1e3/roles/dc2ff8de43f043c1b4d5f9416fefe45e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:26:01.519620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.520282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.520565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.520840 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] PATH_INFO: `/v3/projects/664adab184c14cfba1ea1b0f0646d694` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.522115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] RBAC: Authorizing `identity:get_project(project_id=664adab184c14cfba1ea1b0f0646d694)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.524204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b519e86-4d34-4fd1-bb59-eb4fb45a7e58 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.526096 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 67/128] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:01 2022] GET /identity/v3/projects/664adab184c14cfba1ea1b0f0646d694 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:01.532274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:01.645242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe8283-1185-426b-9d47-50641ae09563 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:01.677958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:01.688794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:01.689442 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:01.689728 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:01.690001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:01.690771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] RBAC: Adding query filter params (role.id=0758c64a8e384ccda9eb5443f4a87c6b, scope.project.id=664adab184c14cfba1ea1b0f0646d694, user.id=1989eb27cf724db5bbe686d58d292980) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:01.691083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:01.692516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df3cd5-303d-4ae1-ad9f-c8ce0f4a10c3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:01.702242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 62/129] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:01 2022] GET /identity/v3/role_assignments?user.id=1989eb27cf724db5bbe686d58d292980&scope.project.id=664adab184c14cfba1ea1b0f0646d694&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:03.288464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf222-08f6-4a09-8b7b-d4f4e336903a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.288996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf222-08f6-4a09-8b7b-d4f4e336903a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.289076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcf222-08f6-4a09-8b7b-d4f4e336903a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.290401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 68/130] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:03.295490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27df8-12c2-4f1d-902e-a9b97e2632d7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.295896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27df8-12c2-4f1d-902e-a9b97e2632d7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.296082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac27df8-12c2-4f1d-902e-a9b97e2632d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.314508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9ac27df8-12c2-4f1d-902e-a9b97e2632d7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:03.315699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9ac27df8-12c2-4f1d-902e-a9b97e2632d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:03.380144 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 63/131] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:03.637230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dced-8bb0-45ae-9341-6dfffdd15b7e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.637437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dced-8bb0-45ae-9341-6dfffdd15b7e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.637714 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50dced-8bb0-45ae-9341-6dfffdd15b7e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.639112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 69/132] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:03.644449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.644739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.645017 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.647284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50dced-8bb0-45ae-9341-6dfffdd15b7e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:03.663890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:03.665089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:03.674426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:03.728926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 64/133] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:03.749042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50dced-8bb0-45ae-9341-6dfffdd15b7e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:03.782049 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:03.782699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.782983 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.783257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.784348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:03.785787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:03.787362 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 70/134] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:03.793345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:03.846865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:03.890025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e031ab5-74f1-4ead-a1c5-f07016fd7201 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:03.922321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:03.922920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:03.923199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:03.923470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:03.924114 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:03.925548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:03.946584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 65/135] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:03 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:03.998224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:04.097648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:04.105099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f85364-9d8c-4387-94c5-9e70dd8b2c50 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:04.142918 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:04.143486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:04.143769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:04.144045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:04.155017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:04.159906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:04.160766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:04.161694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 71/136] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:04.166991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:04.273978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53cb03-a667-4323-8c2d-66eef375f3bd None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:04.287889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:04.313151 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:04.313878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:04.314057 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:04.314372 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:04.315050 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:04.315359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:04.316737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:04.327871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 66/137] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:04.333493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:04.442021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede18259-a41d-43d4-8837-a42bf084e92c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:04.485404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:04.486441 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:04.486939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:04.487400 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] PATH_INFO: `/v3/users/ef58df92e4e84498bc7339031d2dd1e3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:04.488735 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] RBAC: Authorizing `identity:get_user(user_id=ef58df92e4e84498bc7339031d2dd1e3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:04.490425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:04.493089 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 72/138] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:04 2022] GET /identity/v3/users/ef58df92e4e84498bc7339031d2dd1e3 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:04.499023 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:04.605778 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dee737-ab60-4d9f-b89e-cb72f76ed34b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:04.640597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:04.641218 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:04.641502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:04.641776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:04.688868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:04.730801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:04.733342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:04.907730 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 67/139] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:04.916741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:04.959141 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:05.091244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d2551-ef2d-409a-bc06-f7e30c0ba702 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:05.154421 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:05.155497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:05.155981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:05.156464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:05.158379 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:05.161023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f4f2b-b701-4ce9-ade3-9673886f8cd1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:05.165052 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 73/140] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:04 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:05.173489 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:05.305079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:05.351292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc923b-d1f1-4379-8e57-2c9812e1d93b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:05.410262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:05.411607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:05.412371 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:05.413160 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:05.414767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] RBAC: Adding query filter params (role.id=dc2ff8de43f043c1b4d5f9416fefe45e, scope.project.id=ada28e826b664a92bc196ccac52c6a32, user.id=ef58df92e4e84498bc7339031d2dd1e3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:05.415595 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:05.418516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcfc7c-9e4f-405f-8599-c869ba2933ef None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:05.429933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 68/141] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:05 2022] GET /identity/v3/role_assignments?user.id=ef58df92e4e84498bc7339031d2dd1e3&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=dc2ff8de43f043c1b4d5f9416fefe45e => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:06.393560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4a5-0756-4e2c-93b8-7e3cb363098e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.394083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4a5-0756-4e2c-93b8-7e3cb363098e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.394083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba4a5-0756-4e2c-93b8-7e3cb363098e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.395397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 74/142] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:06.401019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30de4-400f-47e1-a6ae-ed5797bbe5ff None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.401414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30de4-400f-47e1-a6ae-ed5797bbe5ff None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.401595 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf30de4-400f-47e1-a6ae-ed5797bbe5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.420286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2cf30de4-400f-47e1-a6ae-ed5797bbe5ff None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:06.421466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2cf30de4-400f-47e1-a6ae-ed5797bbe5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:06.453898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d2df-7abe-4a64-9284-886496da75c8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.454267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d2df-7abe-4a64-9284-886496da75c8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.454488 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6d2df-7abe-4a64-9284-886496da75c8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.455845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 75/143] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:06.461237 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25738-504c-41a3-8867-bdf96fb8c600 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.461519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25738-504c-41a3-8867-bdf96fb8c600 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.461786 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25738-504c-41a3-8867-bdf96fb8c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.479314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dea25738-504c-41a3-8867-bdf96fb8c600 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:06.480515 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dea25738-504c-41a3-8867-bdf96fb8c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:06.492173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 69/144] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:06.556411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 76/145] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:06.637470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6c85-972c-4f3d-9e5a-134e3e443d44 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.637763 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6c85-972c-4f3d-9e5a-134e3e443d44 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.638036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6c85-972c-4f3d-9e5a-134e3e443d44 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.639553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 70/146] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:06.644627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.644862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.645127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.663814 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:06.664981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:06.679573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:06.732592 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 77/147] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:06.761288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f6c85-972c-4f3d-9e5a-134e3e443d44 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:06.825086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:06.829360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:06.867020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f6c85-972c-4f3d-9e5a-134e3e443d44 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:06.902669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:06.903224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.903500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.903767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.913864 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:06.918710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:06.919606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:06.920547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 71/148] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:06.926996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:06.930830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe1415-da12-4759-bb4a-85db90074b65 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:06.965193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:06.965826 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:06.966100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:06.966469 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:06.967650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:06.969034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:06.970784 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 78/149] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:06.976438 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.000776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.033740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94c53-635f-4d70-bde4-0361e9b2985f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.059509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.067594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.068196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.068472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.068737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.069958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:07.070287 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.071649 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.079677 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 72/150] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:07.080665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.080818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384293c-c107-454a-ae45-b3bd25a33d5b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.116458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.117061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.117335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.117605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.118283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.119726 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.141073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 79/151] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:06 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:26:07.141073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.187911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb59b78-b21f-40ee-a368-0090167baae8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.229991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.230796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.231152 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.231479 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.231954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.245000 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:07.250883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:07.251844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:07.253354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 73/152] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:07.258484 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.270713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fcce4c-51da-4a1a-a9f3-5d1b3f9dadd6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.308929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.309580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.309857 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.310126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] PATH_INFO: `/v3/users/7294d876623b4a56992edb541f4b8f63` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.317543 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.327575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] RBAC: Authorizing `identity:get_user(user_id=7294d876623b4a56992edb541f4b8f63)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.329251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.331007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 80/153] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/users/7294d876623b4a56992edb541f4b8f63 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:07.337391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.374852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d634-1415-4fcd-8b5f-8b9d434f6e97 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.416616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.417251 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.417510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.417787 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.418506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:07.418814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.420206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.429825 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 74/154] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:07.436155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.465072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02728a58-c79d-4b5d-93c6-bffed951a427 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.505711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.513993 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.515162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.515456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.515884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.517041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.518813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.520200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 81/155] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:07.526575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.566825 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e7f1-7dce-46e7-b0ed-808a2115e05d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.584284 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.608146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.609363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.609859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.618196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] PATH_INFO: `/v3/users/7294d876623b4a56992edb541f4b8f63` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.618196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] RBAC: Authorizing `identity:get_user(user_id=7294d876623b4a56992edb541f4b8f63)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.618196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.619566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 75/156] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/users/7294d876623b4a56992edb541f4b8f63 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:07.625046 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.654467 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe60f9-3608-4c34-b288-31690078a071 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.691303 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.691976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.692313 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.692593 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/users/7294d876623b4a56992edb541f4b8f63/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.695455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, user_id=7294d876623b4a56992edb541f4b8f63, role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.696910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.714625 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 82/157] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:07 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/users/7294d876623b4a56992edb541f4b8f63/roles/e7fae3c65ae44410ade680c055bb291f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:26:07.750286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432d89-ca43-4780-b57b-80773c24849b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.790856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.791525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.791805 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.792075 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.793318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.794819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb9553-4144-428e-a6a7-c6e068fa7da9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.796699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 76/158] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:07 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:07.802758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:07.873491 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:07.918539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5d701-f163-4e56-b050-b00a55bd6b30 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:07.954784 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:07.955458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:07.955734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:07.956007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/users/7294d876623b4a56992edb541f4b8f63/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:07.957891 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, user_id=7294d876623b4a56992edb541f4b8f63, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:07.959664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351b6c7-e953-4aaa-8881-3f90920730e3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:07.974165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 83/159] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:07 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/users/7294d876623b4a56992edb541f4b8f63/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:09.469666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ee98-ab8c-418b-8868-fcea216667ab None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:09.470415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ee98-ab8c-418b-8868-fcea216667ab None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:09.470415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3ee98-ab8c-418b-8868-fcea216667ab None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:09.471761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 77/160] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:09.477305 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:09.477799 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:09.477956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:09.496521 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:09.497692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:09.545760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f490-ba5e-4066-889a-0a9e41c4bff2 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:09.546045 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f490-ba5e-4066-889a-0a9e41c4bff2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:09.546374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f490-ba5e-4066-889a-0a9e41c4bff2 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:09.547853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 78/161] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:26:09.553062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:09.553347 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:09.553619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:09.572191 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:09.572847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 84/162] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:09.578219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:09.621683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:09.645878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 79/163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:09.855711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:09.911635 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:09.916774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:09.977561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd201f8-5ec9-49fb-90f5-486a60d593c7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.019401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.020045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.020320 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.020587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.031860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-74526d4f-fca9-428b-a0b0-3c3b0d24d9ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:10.036880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:10.037982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:10.039134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:10.039760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278ccff-33b6-4e95-bca0-ff65cd478c36 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.039834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 85/164] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:10.047528 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f348-02de-4dce-aef7-bfee049dc832 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.047855 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f348-02de-4dce-aef7-bfee049dc832 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.048225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f348-02de-4dce-aef7-bfee049dc832 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.049677 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 86/165] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:10.055411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456f348-02de-4dce-aef7-bfee049dc832 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.084186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.085115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.085400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.085674 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.086798 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.088245 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c5fa2-37ac-4e88-9fd6-a6c78c6b81f6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.089989 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 80/166] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:10.090947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.091232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.091505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.110541 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:10.111645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:10.156016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.169443 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456f348-02de-4dce-aef7-bfee049dc832 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.180358 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.183525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 81/167] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:10.184344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.219704 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.220318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.220597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.220869 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.221535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:10.221843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.223281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5957e-3448-42c0-9342-5f5c396f9037 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.231382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 87/168] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:10.232605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c79-efad-4306-84e6-ee0569ad7a03 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.232892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c79-efad-4306-84e6-ee0569ad7a03 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.233164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b1c79-efad-4306-84e6-ee0569ad7a03 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.234550 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 88/169] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:10.239454 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1c79-efad-4306-84e6-ee0569ad7a03 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.292548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fafae9-7067-45da-b909-5f4ab5f98359 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.327796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.328493 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.328772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.329040 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.329680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.331155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69e66-7599-4eab-b9fd-fe673ebd9ab8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.347359 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b1c79-efad-4306-84e6-ee0569ad7a03 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.354838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 82/170] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:10 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:10.359640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.359980 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.360258 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.381836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:10.383417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:10.398612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.399669 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.400312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.400707 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] PATH_INFO: `/v3/users/786a10f038f04407a1465239e72ea0be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.416542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] RBAC: Authorizing `identity:get_user(user_id=786a10f038f04407a1465239e72ea0be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.418212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.419337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.421284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 89/171] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/users/786a10f038f04407a1465239e72ea0be => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:10.427452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.465222 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.475368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 83/172] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:10.476918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.552173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d903e-01a3-437d-8c0b-13c3e62f6a5b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.604764 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.605648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.606039 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.606411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.608766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.610343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.612146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 90/173] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:10.618450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415d6de-9e31-450e-bde4-a50daf6d34df None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.618836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.663744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.664738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.665215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.665676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.678487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:10.684613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:10.685497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:10.686336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:10.688588 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 84/174] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:10.696406 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.730796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.751268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acb258-5e19-4b9a-abd7-2ded0f5b9ebc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.753688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:10.796388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.797100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.797375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.797647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/users/786a10f038f04407a1465239e72ea0be/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.801154 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, user_id=786a10f038f04407a1465239e72ea0be, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.803267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.819092 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 91/175] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:10 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/users/786a10f038f04407a1465239e72ea0be/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:26:10.819927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:10.823642 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90723-c4d0-493c-a92a-b680bf42271b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:10.865650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:10.866405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:10.866732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:10.867009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:10.867688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:10.867986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:10.869384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:10.878945 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 85/176] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:10.886304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.002685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e647da8-4dcc-4744-94b5-b9177295ea21 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.044005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.044641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.044919 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.045191 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.046525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:11.059080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:11.065263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:11.066135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:11.066940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:11.068252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e00d-c42a-4e0f-90e6-53365909bdba None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.069962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 92/177] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:11.078477 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.113862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:11.122160 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.122934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.123208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.123473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] PATH_INFO: `/v3/users/7294d876623b4a56992edb541f4b8f63` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.127915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] RBAC: Authorizing `identity:get_user(user_id=7294d876623b4a56992edb541f4b8f63)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:11.129379 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:11.133958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 86/178] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:10 2022] GET /identity/v3/users/7294d876623b4a56992edb541f4b8f63 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:11.142486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.292938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d8cec-6b9e-46dc-9efb-6a8c967887be None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.305140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325317e-7673-4912-81bd-3fd1436b952d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.363989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.365874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.366477 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.366957 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.367815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:11.368545 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:11.371310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:11.381434 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.382060 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.382372 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.382646 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.384060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 93/179] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:11.391508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.426516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:11.513537 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:11.515807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:11.582620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:11.620936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 87/180] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:11.626542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.672169 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ee900-2ad5-4c0b-bb46-5619eaf53f80 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.686537 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:11.738186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869bd6d-8a08-4592-b590-4a82296b2139 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:11.775384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.776028 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.776308 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.776581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.777918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:11.779289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:11.780921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 88/181] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:11.786695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.793011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:11.793667 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:11.793948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:11.794258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] PATH_INFO: `/v3/users/7294d876623b4a56992edb541f4b8f63` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:11.796296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=7294d876623b4a56992edb541f4b8f63)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:11.797762 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:11.808210 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 94/182] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/users/7294d876623b4a56992edb541f4b8f63 => generated 283 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:11.811776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:11.977366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65897b76-719b-4a85-bcca-f64729a77269 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:12.014506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:12.020730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5cb3d-0a27-49df-92e0-1751824c0fd2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:12.042625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:12.043242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.043524 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.043798 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:12.044533 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] RBAC: Adding query filter params (role.id=e7fae3c65ae44410ade680c055bb291f, scope.project.id=c278a677c48b41e48007151a067076ab, user.id=7294d876623b4a56992edb541f4b8f63) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:12.044841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:12.046315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:12.061858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/role_assignments?user.id=7294d876623b4a56992edb541f4b8f63&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=e7fae3c65ae44410ade680c055bb291f => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:12.090436 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:12.091079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.091363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.091639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:12.122909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:12.197093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:12.198586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:12.328724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 95/184] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:12.335042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:12.451105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2ae3-9e01-4598-956b-4e3f1855c6db None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:12.494488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:12.495141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.495423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.495695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:12.496849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:12.498368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec9fb1-7484-4a8e-9129-fd9a8b94aecc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:12.500201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 90/185] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:12 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:12.506738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:12.576984 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:12.628664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768234fd-f78e-4a5a-8152-6d160f53fe7d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:12.668485 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:12.669099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.669373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.669642 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:12.670397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=c278a677c48b41e48007151a067076ab, user.id=7294d876623b4a56992edb541f4b8f63) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:12.670701 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:12.672134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64961293-51da-4aff-87f6-4350d51b4886 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:12.678261 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 96/186] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:12 2022] GET /identity/v3/role_assignments?user.id=7294d876623b4a56992edb541f4b8f63&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:12.989357 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03a06-f0e1-41b6-b523-697e89cb656e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.990394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03a06-f0e1-41b6-b523-697e89cb656e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.990657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb03a06-f0e1-41b6-b523-697e89cb656e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:12.993789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 91/187] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:12.998969 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159d62-d3ff-40af-9965-ab473c023991 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:12.999252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159d62-d3ff-40af-9965-ab473c023991 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:12.999522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159d62-d3ff-40af-9965-ab473c023991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.017926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-20159d62-d3ff-40af-9965-ab473c023991 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:13.019161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-20159d62-d3ff-40af-9965-ab473c023991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:13.045164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb688-0f35-49ac-ba79-9c1181ead5d2 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.045464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb688-0f35-49ac-ba79-9c1181ead5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.045720 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb688-0f35-49ac-ba79-9c1181ead5d2 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.047090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 92/188] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:26:13.051874 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016638-3f3e-4e2d-9ef5-274cf0805159 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.052157 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016638-3f3e-4e2d-9ef5-274cf0805159 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.053012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016638-3f3e-4e2d-9ef5-274cf0805159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.071969 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9b016638-3f3e-4e2d-9ef5-274cf0805159 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:13.073161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9b016638-3f3e-4e2d-9ef5-274cf0805159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:13.091608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 97/189] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:13.121449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.142438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 93/190] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:13.293221 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb202-ba82-4083-9582-20ccfb2186e8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.293545 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb202-ba82-4083-9582-20ccfb2186e8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.293716 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb202-ba82-4083-9582-20ccfb2186e8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.295211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 98/191] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:13.300321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.300611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.300886 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.319756 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:13.320933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:13.357349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cb202-ba82-4083-9582-20ccfb2186e8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.389872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 94/192] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:13.406982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.408263 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.469694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cb202-ba82-4083-9582-20ccfb2186e8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.503806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.504426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.504706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.504980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.510420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b12c-a9e4-4b5d-8cfe-2d7a98ea8d4a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.514951 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:13.519754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:13.520696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:13.522343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 99/193] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:13.527215 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.529222 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.551546 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.552709 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.553086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.553359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.554686 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:13.556195 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:13.557963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 95/194] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:13.563033 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.634860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851d957-87e0-4f71-88b2-73d814fd4eb3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.636503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.667031 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9468a88-91a3-4d68-ae13-5bc95e523a47 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.673800 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.674444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.674720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.674990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.675647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] RBAC: Adding query filter params (name=reader) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:13.675952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:13.677930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:13.686056 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 100/195] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:13.688201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.701257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.701955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.702334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.702611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.703255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:13.704751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:13.725747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 96/196] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:13 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:26:13.731398 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.776033 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.796678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95507-62a2-46cc-a842-bddec814d1db None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.837061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.837675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.837954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.838253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.850583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:13.856232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:13.857267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:13.858090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 101/197] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:13.859226 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba1503-160a-435a-b67d-c8f02e912f8b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:13.863640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.892625 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:13.899143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:13.899868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:13.901051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:13.901051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] PATH_INFO: `/v3/users/5eed0a2425074e4e856f220c97c9d1a7` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:13.916106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] RBAC: Authorizing `identity:get_user(user_id=5eed0a2425074e4e856f220c97c9d1a7)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:13.917635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:13.919543 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 97/198] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/users/5eed0a2425074e4e856f220c97c9d1a7 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:13.924757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:13.981299 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed84ecf-ac31-4928-a19d-48aded96275a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.033576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.034219 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.034507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.034781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.035450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:14.035758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.038671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.048667 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 102/199] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:14.050742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:14.056267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:14.060211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905fb18-3c5c-4704-b50b-841347051d7c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.106724 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.107327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.107621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.107891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.109571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.112905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.113133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 98/200] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:13 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:14.120513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:14.155797 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:14.174991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa126f7b-c21d-45a4-a84e-44c68c4d1728 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.220492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.221911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.222227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.222510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] PATH_INFO: `/v3/users/786a10f038f04407a1465239e72ea0be` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.223669 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] RBAC: Authorizing `identity:get_user(user_id=786a10f038f04407a1465239e72ea0be)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.225672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.228045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 103/201] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:14 2022] GET /identity/v3/users/786a10f038f04407a1465239e72ea0be => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:14.233019 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:14.263506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74553b74-6fdf-4a91-8ec8-2df145f5e691 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.304563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.305363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.305755 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.306124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/users/5eed0a2425074e4e856f220c97c9d1a7/roles/dc2ff8de43f043c1b4d5f9416fefe45e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.308564 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, user_id=5eed0a2425074e4e856f220c97c9d1a7, role_id=dc2ff8de43f043c1b4d5f9416fefe45e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.310012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.329019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 99/202] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:14 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/users/5eed0a2425074e4e856f220c97c9d1a7/roles/dc2ff8de43f043c1b4d5f9416fefe45e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:14.357583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1eec-8b12-447d-b13f-30ea507a0e8c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.401973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.402654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.402938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.403215 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.432836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:14.481836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.483390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.590430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 104/203] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 14:26:14.597164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:14.626806 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:14.706448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371550fb-5ddd-4d4e-9367-3074f31c9f06 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.741818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.742503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.742785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.743062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.744209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.745668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b68b2-01bc-4efa-8130-9b4f05d121c2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.747364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 100/204] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:14 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:14.753567 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:14.812017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:14.860757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db927923-49a8-4951-9afe-fa12e70234ad None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:14.896643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:14.897179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:14.897459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:14.897736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:14.898496 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] RBAC: Adding query filter params (role.id=0758c64a8e384ccda9eb5443f4a87c6b, scope.project.id=c278a677c48b41e48007151a067076ab, user.id=786a10f038f04407a1465239e72ea0be) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:14.899087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:14.900533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706a537-49a7-4609-a176-c30ec017b801 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:14.906290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 105/205] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:14 2022] GET /identity/v3/role_assignments?user.id=786a10f038f04407a1465239e72ea0be&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:16.049592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0e04-fe78-4607-8497-6fa404f6a595 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.050111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0e04-fe78-4607-8497-6fa404f6a595 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.050111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee0e04-fe78-4607-8497-6fa404f6a595 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.052363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 101/206] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:16.057947 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d59-698a-4191-97be-f9198a7d153e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.058508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d59-698a-4191-97be-f9198a7d153e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.058583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10d59-698a-4191-97be-f9198a7d153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.077254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-cef10d59-698a-4191-97be-f9198a7d153e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:16.078475 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cef10d59-698a-4191-97be-f9198a7d153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:16.148878 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 106/207] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:16.154986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6490-c67e-4c4a-b3bf-d010fba46031 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.155269 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6490-c67e-4c4a-b3bf-d010fba46031 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.155540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c6490-c67e-4c4a-b3bf-d010fba46031 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.156989 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 102/208] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:16.162487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.162776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.163028 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.181657 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:16.182863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:16.226131 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:16.251088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 107/209] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:16.413890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c6490-c67e-4c4a-b3bf-d010fba46031 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:16.510089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:16.518460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:16.523279 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c6490-c67e-4c4a-b3bf-d010fba46031 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:16.560213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:16.560841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.561117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.561384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.571464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2430cfe6-ec29-481f-96ae-6ca3cbbbe734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:16.576275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:16.577130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:16.577918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 103/210] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:16.578591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e6af-0b63-40c2-ad20-cdf69538f755 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.579229 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e6af-0b63-40c2-ad20-cdf69538f755 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.579485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e6af-0b63-40c2-ad20-cdf69538f755 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.580867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 104/211] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:16.583581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0e6af-0b63-40c2-ad20-cdf69538f755 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:16.625581 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6543c-f351-4195-8296-ad33543c8b19 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:16.658956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:16.659585 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.659854 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.660161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.661295 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:16.662789 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284d0a8-85fd-43eb-a993-babea4e361cb None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:16.664352 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 108/212] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:16.665568 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.665845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.666112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.683824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:16.685025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:16.688413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0e6af-0b63-40c2-ad20-cdf69538f755 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:16.723113 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:16.723793 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.724065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.724328 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.724984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:16.725276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:16.726674 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:16.727157 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:16.734794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 105/213] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:16.735556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:16.750079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:16.757826 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 109/214] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:16.762382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:16.842146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33900581-405d-4343-8c8d-e6f9b168a31b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:16.866815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df04828-43d7-4173-aeae-8545128946d1 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:16.881076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:16.881911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.882019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.882254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.882904 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:16.884350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:16.903101 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:16.903738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:16.904016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:16.904287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] PATH_INFO: `/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:16.906871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 106/215] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:16 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:16.919967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] RBAC: Authorizing `identity:get_user(user_id=ec1278d8249c45b4bfeee9ff4d83d1da)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:16.921473 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:16.928900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 110/216] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:16 2022] GET /identity/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:16.930231 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:17.006508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:17.032331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:17.048694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c493e44-2461-4c68-97fe-02227cbd7e60 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:17.069469 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:17.090698 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:17.091656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:17.091656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:17.091908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:17.092593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] RBAC: Adding query filter params (role.id=0758c64a8e384ccda9eb5443f4a87c6b, user.id=ec1278d8249c45b4bfeee9ff4d83d1da, scope.system=all) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:17.093449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:17.095084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:17.102859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 107/217] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 12 14:26:16 2022] GET /identity/v3/role_assignments?user.id=ec1278d8249c45b4bfeee9ff4d83d1da&scope.system=all&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:17.162073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5adf4-5749-4b39-9dbf-8c5b9476aa8f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:17.201956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:17.202692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:17.202972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:17.203247 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:17.216465 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:17.221970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:17.223000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:17.223874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 111/218] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:17.229588 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:17.350186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65519-e6e2-41ba-8fc9-a6a25355899d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:17.382068 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:17.388204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:17.388869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:17.389154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:17.389430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:17.390538 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:17.391066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:17.392556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:17.401940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 108/219] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:17.407602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:17.512733 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:17.521866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8ae0e-4429-4d09-8a74-c95777c1479d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:17.559402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:17.560370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:17.560893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:17.561376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] PATH_INFO: `/v3/users/5eed0a2425074e4e856f220c97c9d1a7` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:17.562896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] RBAC: Authorizing `identity:get_user(user_id=5eed0a2425074e4e856f220c97c9d1a7)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:17.564536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:17.566968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 112/220] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:17 2022] GET /identity/v3/users/5eed0a2425074e4e856f220c97c9d1a7 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:17.573057 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:17.682771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b6d3-46df-4209-bbdd-2bde10276520 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:17.717918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:17.718565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:17.718843 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:17.719115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:17.782932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:17.791706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:17.793313 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:17.899085 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 109/221] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:17.904712 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:18.018372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe29a3c-6fee-4ffd-971e-0812e9fee139 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:18.058066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:18.058776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:18.059052 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:18.059375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:18.060553 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:18.062016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99542dd1-db5f-4a8e-b93a-865d4aa1da82 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:18.063986 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 113/222] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:17 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:18.070346 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:18.164832 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:18.176052 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a4bba-e49d-49a7-8aa4-75935aa844c9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:18.211065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:18.211914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:18.212333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:18.212745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:18.213622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] RBAC: Adding query filter params (role.id=dc2ff8de43f043c1b4d5f9416fefe45e, scope.project.id=c278a677c48b41e48007151a067076ab, user.id=5eed0a2425074e4e856f220c97c9d1a7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:18.214080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:18.215725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4320593-28ad-48df-814e-ccd7f20e3a93 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:18.222051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 110/223] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:18 2022] GET /identity/v3/role_assignments?user.id=5eed0a2425074e4e856f220c97c9d1a7&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=dc2ff8de43f043c1b4d5f9416fefe45e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:19.266400 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a46-d823-4b4e-bfdc-a23fbfcd6ab7 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.266884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a46-d823-4b4e-bfdc-a23fbfcd6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.266884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7033a46-d823-4b4e-bfdc-a23fbfcd6ab7 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.268369 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 114/224] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:19.274215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd3de-a80a-4989-944e-3e7fa9fb153f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.274598 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd3de-a80a-4989-944e-3e7fa9fb153f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.274776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cd3de-a80a-4989-944e-3e7fa9fb153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.293230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-779cd3de-a80a-4989-944e-3e7fa9fb153f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:19.294469 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-779cd3de-a80a-4989-944e-3e7fa9fb153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:19.302753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbec8e-2e49-4c81-86e1-6b647533f122 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.303038 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbec8e-2e49-4c81-86e1-6b647533f122 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.303312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbec8e-2e49-4c81-86e1-6b647533f122 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.304794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 115/225] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:19.309350 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.309631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.309901 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.328128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:19.329310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:19.353688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:19.366523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 111/226] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:19.367777 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65440d7-22ae-4da4-adc1-24dcfe3a65d0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.368061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65440d7-22ae-4da4-adc1-24dcfe3a65d0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.368328 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65440d7-22ae-4da4-adc1-24dcfe3a65d0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.369691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 112/227] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:19.374701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.374996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.375251 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.392970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:19.394288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:19.399871 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 116/228] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:19.461920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 113/229] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:19.632628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:19.671354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:19.690200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:19.732330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498702a3-45b3-41a1-9f16-ebe7c890ed11 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:19.766691 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:19.767323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.767603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.767875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.773301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b295-4ef1-4745-8b56-54cc1cd7020c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:19.778643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:19.783502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:19.784578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:19.785464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 117/230] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:19.786663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:19.808391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:19.810241 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:19.810871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.811154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.811432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.821333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:19.826166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:19.827163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:19.827942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 114/231] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:19.828598 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:19.887321 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597f01c-44f5-4fbd-bccb-3672c195911e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:19.903365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:19.921272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:19.921918 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.922233 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.922534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.923641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:19.925093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:19.925199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258c61-b4e4-4457-92d7-a66863956c5b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:19.926995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 118/232] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:19.927552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:19.962295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:19.962902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:19.963183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:19.963458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:19.964123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:19.964429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:19.965869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:19.974580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 115/233] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:19.975433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:20.022253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:20.034241 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cce42-667b-4ca4-bd8f-9ab8847bcbb0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.067367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.067965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.068239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.068514 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.069178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:20.069472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.070885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.076668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26a33a-401f-4b88-af53-3cd0fdf4fe90 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.078693 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 119/234] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:20.079472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:20.114508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.115114 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.115391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.115656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] PATH_INFO: `/v3/groups` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.116279 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.117706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.128887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:20.133892 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 116/235] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Oct 12 14:26:19 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:20.134678 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:20.209484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b8-dd13-4a82-b404-384f4c5f5341 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.247364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f4929-ab0d-492a-bbbd-4435c8b34434 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.250411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.251066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.251350 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.251628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] PATH_INFO: `/v3/users/85ed4d8337ae48f287f5baec2703e89d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.267573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] RBAC: Authorizing `identity:get_user(user_id=85ed4d8337ae48f287f5baec2703e89d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.269114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.271941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 120/236] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:20 2022] GET /identity/v3/users/85ed4d8337ae48f287f5baec2703e89d => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:20.277860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:20.285447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.286108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.286450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.286727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] PATH_INFO: `/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.287921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] RBAC: Authorizing `identity:get_user(user_id=ec1278d8249c45b4bfeee9ff4d83d1da)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.289400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.289923 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:20.291252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 117/237] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:20 2022] GET /identity/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:20.297374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:20.372371 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:20.397820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec6611-73f9-42f0-ae37-e5a48699bac1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.408504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d360a-784c-40c5-801c-dcbcc8212e0c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:20.436831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.437749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.438259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.438519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.439251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] RBAC: Adding query filter params (role.id=dc2ff8de43f043c1b4d5f9416fefe45e, user.id=85ed4d8337ae48f287f5baec2703e89d, scope.system=all) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:20.439566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.441005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fca3f2-fae6-447a-8e63-e44dc2f86ef7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.442745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:20.443409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:20.443875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:20.443991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] PATH_INFO: `/v3/system/users/ec1278d8249c45b4bfeee9ff4d83d1da/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:20.445314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec1278d8249c45b4bfeee9ff4d83d1da, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:20.446818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 121/238] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 12 14:26:20 2022] GET /identity/v3/role_assignments?user.id=85ed4d8337ae48f287f5baec2703e89d&scope.system=all&role.id=dc2ff8de43f043c1b4d5f9416fefe45e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:20.446920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aad65f-707f-433e-96aa-282fce8e19e6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:20.455876 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 118/239] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Oct 12 14:26:20 2022] PUT /identity/v3/system/users/ec1278d8249c45b4bfeee9ff4d83d1da/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:26:22.301054 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f936b-c3b8-42e2-bc3f-9a9de946de3d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.301536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f936b-c3b8-42e2-bc3f-9a9de946de3d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.301536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f936b-c3b8-42e2-bc3f-9a9de946de3d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.303040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 122/240] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:22.308025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17a14-d339-4440-a271-27f0e694c655 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.308394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17a14-d339-4440-a271-27f0e694c655 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.308557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17a14-d339-4440-a271-27f0e694c655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.327523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-78f17a14-d339-4440-a271-27f0e694c655 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:22.328705 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-78f17a14-d339-4440-a271-27f0e694c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:22.398221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 119/241] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:22.606081 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2adde-6dae-4a06-a1f3-78bc77d1b0ef None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.606442 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2adde-6dae-4a06-a1f3-78bc77d1b0ef None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.606607 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2adde-6dae-4a06-a1f3-78bc77d1b0ef None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.608071 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 123/242] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:22.613096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.613385 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.613585 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1635-2159-4074-9601-3325b39fd533 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.613678 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.613868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1635-2159-4074-9601-3325b39fd533 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.614139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1635-2159-4074-9601-3325b39fd533 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.615562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 124/243] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:22.620162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.620449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.620725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.632260 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:22.633453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:22.641037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:22.642266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:22.694513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:22.705784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 120/244] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:22.707254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:22.713668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 125/245] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:22.813640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a06e1-3b8e-4160-8c19-b76359eadfcb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:22.847112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:22.847790 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.848068 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.848338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.849427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:22.850897 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:22.852613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 121/246] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:22.857971 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:22.860493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:22.955771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89cbe6-4868-488c-b16f-16ba575c1114 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:22.978837 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:22.993975 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:22.995150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:22.995150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:22.995403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] PATH_INFO: `/v3/groups` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:22.996042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:22.997508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.014094 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 126/247] 10.222.0.27 () {60 vars in 1134 bytes} [Wed Oct 12 14:26:22 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:23.014926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.059576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.085207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.109100 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560204f1-fe36-455d-8b3e-b7fdbc7305dd None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.128092 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425547e0-bc3b-442e-add2-b4323c570589 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.148431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.149084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.149363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.149640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.161896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:23.166250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.166899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.167175 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.167443 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:23.167548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:23.168392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:23.169938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 122/248] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:23.174610 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.181487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:23.186895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:23.187815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:23.188782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 127/249] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:23.194258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.288297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdce9db-ebe9-4419-9ab2-6da2a5fd6149 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.310211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.315000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265d26-7fcf-4406-a3d4-fd303de5559e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.325564 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.326321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.326600 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.326869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.327641 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:23.327936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.329306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.340201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 123/250] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:23.342815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.345974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.364934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.366100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.366100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.366100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.367117 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:23.367426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.368864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.377868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 128/251] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:23.383172 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.482467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c2e62-c94a-4b96-a13a-7316b4a22d8d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.505859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740e7ca-b9a2-411e-adfb-b53dcb5caa1c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.522637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.524168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.524168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.524168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] PATH_INFO: `/v3/users/85ed4d8337ae48f287f5baec2703e89d` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.525669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] RBAC: Authorizing `identity:get_user(user_id=85ed4d8337ae48f287f5baec2703e89d)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.527835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.529149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 124/252] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/users/85ed4d8337ae48f287f5baec2703e89d => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:23.536080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.555171 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.557088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.557884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.558379 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] PATH_INFO: `/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.560108 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] RBAC: Authorizing `identity:get_user(user_id=ec1278d8249c45b4bfeee9ff4d83d1da)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.562258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.565137 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 129/253] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/users/ec1278d8249c45b4bfeee9ff4d83d1da => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:23.571287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:23.609828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.648934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:23.694661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35035b-1289-40c2-a09a-086004ccd4f9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.701110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a0f2-ffa2-49a1-89cd-911c038d80e4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:23.736162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.736766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.737042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.737312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.738202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] RBAC: Adding query filter params (role.id=0758c64a8e384ccda9eb5443f4a87c6b, user.id=ec1278d8249c45b4bfeee9ff4d83d1da, scope.system=all) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:23.738514 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.738869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:23.739535 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:23.739815 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:23.739967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8421fa-fbb6-4556-82d4-a2062faf35f5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.740113 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] PATH_INFO: `/v3/system/users/85ed4d8337ae48f287f5baec2703e89d/roles/dc2ff8de43f043c1b4d5f9416fefe45e` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:23.743331 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85ed4d8337ae48f287f5baec2703e89d, role_id=dc2ff8de43f043c1b4d5f9416fefe45e)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:23.745123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88f3c8-36ce-42ca-a36f-4b1d11e3e375 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:23.756377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 125/254] 10.222.0.27 () {58 vars in 1334 bytes} [Wed Oct 12 14:26:23 2022] PUT /identity/v3/system/users/85ed4d8337ae48f287f5baec2703e89d/roles/dc2ff8de43f043c1b4d5f9416fefe45e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:23.760335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 130/255] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 12 14:26:23 2022] GET /identity/v3/role_assignments?user.id=ec1278d8249c45b4bfeee9ff4d83d1da&scope.system=all&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:25.376096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158658-4898-4992-8137-d2cd6fd95b8b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:25.376577 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158658-4898-4992-8137-d2cd6fd95b8b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:25.376577 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80158658-4898-4992-8137-d2cd6fd95b8b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:25.378501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 126/256] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:25.384107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:25.384591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:25.384665 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:25.406994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:25.408209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:25.485656 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 131/257] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:26:25.869211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158658-4898-4992-8137-d2cd6fd95b8b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:25.882604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80158658-4898-4992-8137-d2cd6fd95b8b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:25.887330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:25.888197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:25.888711 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:25.889176 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:25.903733 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:25.909534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:25.910417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:25.911219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:25.913462 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 127/258] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:25.920781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:25.930638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141378-9eeb-4d4a-a080-7b815ccbd4a4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:25.935736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:25.936635 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:25.937111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:25.937577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:25.938540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:25.939125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:25.941700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:25.941700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 12 14:26:25.941700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: Oct 12 14:26:25.943017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:25.952907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 132/259] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:25.958927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:25.969640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7f835-7689-46b1-abf5-29da65b09af2 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:25.975582 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:25.976557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:25.977066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:25.977530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:25.985314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:25.987680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:25.987680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:26:25.987680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:26:25.989365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:25.991490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 128/260] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 12 14:26:25 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:25.997978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:26.010202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dec6d4-be55-478e-a351-775891664a74 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:26.018503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:26.019841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.020351 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.020821 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.027021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:26.029539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770ead0-aded-490f-9907-9c84b4d3c1ce admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:26.031614 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 133/261] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:26:25 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:26.037994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:26.051540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b417a9-765c-4edc-bf5e-15b1e3383058 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:26.057890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:26.058875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.059354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.059822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.062055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, group_id=9bcbd8acdc4c4809a7979d20eb85a08c, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:26.063312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:26.063312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:26:26.063312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:26:26.066231 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc03cf-3fb8-49e6-a7a3-24f07441e818 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:26.084498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 129/262] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 12 14:26:26 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:26.224192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe7ff-7d86-44af-927c-6ee58e69f020 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.224854 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe7ff-7d86-44af-927c-6ee58e69f020 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.225327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbe7ff-7d86-44af-927c-6ee58e69f020 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.226910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 134/263] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:26.232987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cea0-a2b1-422b-ad0e-3a69f5e8c90c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.233570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cea0-a2b1-422b-ad0e-3a69f5e8c90c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.234039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cea0-a2b1-422b-ad0e-3a69f5e8c90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.263510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1003cea0-a2b1-422b-ad0e-3a69f5e8c90c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:26.265082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1003cea0-a2b1-422b-ad0e-3a69f5e8c90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:26.352973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 130/264] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:26:26.676023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397a2b-b73f-41b0-ae5e-c5844c27ed31 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.676992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397a2b-b73f-41b0-ae5e-c5844c27ed31 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.677488 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e397a2b-b73f-41b0-ae5e-c5844c27ed31 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.679061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 135/265] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:26.686099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.687030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.687501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.693169 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cb1-27e4-41ad-a512-ff54743ea221 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.693694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cb1-27e4-41ad-a512-ff54743ea221 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.694162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cb1-27e4-41ad-a512-ff54743ea221 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.696009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 136/266] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:26:26.701467 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.702021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.702533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.715037 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:26.716237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:26.743335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:26.744546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:26.770487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 137/267] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:26:26.773005 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:26.838915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 131/268] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:26.907523 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:26.923447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd49df-bd18-45f5-af35-96901f69b36d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:26.928186 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:26.928765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.929045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.929316 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.945973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:26.950955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:26.951818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:26.952626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 138/269] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:26.959727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:26.972952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257556-cab3-4485-b25f-aa0753c8e59e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:26.977518 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:26.978121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:26.978432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:26.978704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:26.979373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:26.979672 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:26.980695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:26.980695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:26:26.980695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:26:26.981611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:26.990675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 132/270] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 12 14:26:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:26.996746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.007718 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590fc01-f608-469f-a0a1-10aa9676486d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.018872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.019769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.020050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.020324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.021463 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.022522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:27.022522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 12 14:26:27.022522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: Oct 12 14:26:27.023752 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.025342 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 139/271] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 12 14:26:26 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:27.031119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.041407 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daa240-1c18-4d23-b4c4-21690ac9c5f7 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.050783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.051420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.051699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.051974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.053134 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.055250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.056880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 133/272] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:27.063434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.077651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8394e90-3022-46a5-8290-f5410cde9bbd admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.082795 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.083478 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.083725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.083997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.091996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada28e826b664a92bc196ccac52c6a32, group_id=9bcbd8acdc4c4809a7979d20eb85a08c, role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.093043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:26:27.093043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 12 14:26:27.093043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: Oct 12 14:26:27.095037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.119068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 140/273] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 12 14:26:27 2022] PUT /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/e7fae3c65ae44410ade680c055bb291f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:27.282954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.293395 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb941cca-4151-42a8-a953-75eee34d2d6b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.315714 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.329037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:27.442423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.443072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.443349 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.443619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.465607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:27.472355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:27.473286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:27.474093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 134/274] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:27.482076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.503383 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66d103-4240-4dc9-9ded-dfe4ca8ba12a admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.517115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.517745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.518254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.518663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.519598 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:27.519906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.521529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a2767-82cb-4b4f-be28-29561f619b5d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.526151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3647f-456b-48ee-922e-d4063e0c6671 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.537933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 135/275] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:27.539477 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a80ce-720b-42ad-a845-ba032fe629d3 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.539901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a80ce-720b-42ad-a845-ba032fe629d3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.540327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a80ce-720b-42ad-a845-ba032fe629d3 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.541694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 136/276] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:27.544865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a80ce-720b-42ad-a845-ba032fe629d3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.565401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a80ce-720b-42ad-a845-ba032fe629d3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.576085 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.577819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.578860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.579727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.582097 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.585739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e88744-732f-4837-99db-86baa1d6e306 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.590567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 137/277] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:27.592126 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.592551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.592960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.593069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.593833 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.597045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.597045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.618962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:27.620652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:27.621472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:27.626595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:27.628230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 14:26:27.629199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:27.631159 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 141/278] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:27.632035 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.636860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 138/279] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:26:27.641010 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.659809 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023f83-21ef-474e-8244-cea9f8c384b7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.675803 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.676955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.677481 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.677786 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.679995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.682921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.685377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 142/280] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:27.692264 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.721685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bc25e-d66e-4568-8d58-7cb8dbc094a3 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.730566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:27.744891 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.745668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.746025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.746407 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.754995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, group_id=9bcbd8acdc4c4809a7979d20eb85a08c, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.757837 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.766513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a78f1-e0d2-465b-8569-3f2740c935a1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:27.795301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 143/281] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 12 14:26:27 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:27.807212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:27.808080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:27.808500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:27.808946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:27.809808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:27.810297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:27.811893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:27.822656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 139/282] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:27.828842 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:27.901705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:27.963734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3b09-6614-43c4-afc1-e8ecbe3da803 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.003587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.004250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.004528 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.004803 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] PATH_INFO: `/v3/users/85ed4d8337ae48f287f5baec2703e89d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.005942 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=85ed4d8337ae48f287f5baec2703e89d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.007520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.009341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 144/283] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:26:27 2022] GET /identity/v3/users/85ed4d8337ae48f287f5baec2703e89d => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:28.015088 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.124748 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fb6a5-73db-4b81-a8c7-900eb6b23745 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.160231 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:28.165408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.166087 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.166471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.166743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.167479 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] RBAC: Adding query filter params (role.id=dc2ff8de43f043c1b4d5f9416fefe45e, user.id=85ed4d8337ae48f287f5baec2703e89d, scope.system=all) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:28.167788 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.169236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.186281 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 140/284] 10.222.0.27 () {56 vars in 1308 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/role_assignments?user.id=85ed4d8337ae48f287f5baec2703e89d&scope.system=all&role.id=dc2ff8de43f043c1b4d5f9416fefe45e => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:28.212749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.303614 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03dbb-761e-4367-847e-058f2aa93bc9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.308256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.308900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.309178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.309450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.324741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:28.329791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:28.331843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:28.332850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 145/285] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:28.339898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.352292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f4d3e-86d9-4bf6-9676-caf49e36b2a2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.357027 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.357723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.358012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.358449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.359272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:28.359604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.361318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.372900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 141/286] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:28.379449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.391651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9848df-1805-46be-af59-88d836fb7fbd admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.398985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.399643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.399921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.400249 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.401598 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.403828 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.405794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 146/287] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:28.412182 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.423262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91691-f349-4ea9-9eaf-b5b3598c3a66 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.431070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.431839 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.432165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.432438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.433948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.436242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa692d35-e9ec-400c-bec9-b0ff114d0861 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.438021 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 142/288] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:28.444542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.455676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88416c-0a34-4f94-98e8-31b92c9fb549 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.462499 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.463307 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.463588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.463902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.466423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c278a677c48b41e48007151a067076ab, group_id=9bcbd8acdc4c4809a7979d20eb85a08c, role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:28.469315 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534699-bf06-4bfa-9e63-56ec5305fe0c admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:28.492167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 147/289] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 12 14:26:28 2022] PUT /identity/v3/projects/c278a677c48b41e48007151a067076ab/groups/9bcbd8acdc4c4809a7979d20eb85a08c/roles/e7fae3c65ae44410ade680c055bb291f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:28.533891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb2dd-d086-451a-a78e-68f27aa0530f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.534254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb2dd-d086-451a-a78e-68f27aa0530f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.534468 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebb2dd-d086-451a-a78e-68f27aa0530f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.536072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 143/290] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:28.541974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.542312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.542540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.569209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:28.570452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:28.639037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:28.647225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 148/291] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 14:26:28.948543 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebb2dd-d086-451a-a78e-68f27aa0530f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:28.961498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebb2dd-d086-451a-a78e-68f27aa0530f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:28.965969 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:28.966617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:28.966895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:28.967164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:28.978819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:28.985035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:28.995262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:28.997702 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 144/292] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:28.999290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:29.002615 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452db71-164c-4ca6-8be6-9d142c721fe8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:29.005501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:29.006110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.006425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.006699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.007419 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:29.007725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:29.009388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:29.018590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 149/293] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:29.024596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:29.036064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85fc3a-965a-4549-afc6-5b3cff5a39b5 admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:29.040779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:29.041252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.041587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.041916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] PATH_INFO: `/v3/groups/d26b94603faa42adaaf823e3a2ed1eac` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.047404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] RBAC: Authorizing `identity:get_group(group_id=d26b94603faa42adaaf823e3a2ed1eac)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:29.049472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:29.051584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 145/294] 10.222.0.27 () {56 vars in 1201 bytes} [Wed Oct 12 14:26:29 2022] GET /identity/v3/groups/d26b94603faa42adaaf823e3a2ed1eac => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:29.057164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:29.068404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39281ed8-d704-44c2-86e0-0a39b21d60d6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:29.073166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:29.073791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.074125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.074428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] PATH_INFO: `/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.075606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=12a7cca3f1ca479292dd1f33c68bdb7c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:29.077628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f19bb-2923-4b54-b546-cde7c9f101f0 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:29.079633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 150/295] 10.222.0.27 () {56 vars in 1207 bytes} [Wed Oct 12 14:26:29 2022] GET /identity/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:29.085594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:29.096841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05d1fe-179a-455f-bf15-d2c743a3109d admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:29.101509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:29.102307 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.102597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.102914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] PATH_INFO: `/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c/groups/d26b94603faa42adaaf823e3a2ed1eac/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.104886 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a7cca3f1ca479292dd1f33c68bdb7c, group_id=d26b94603faa42adaaf823e3a2ed1eac, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:29.107834 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bf709-ed6e-4905-9f7b-c473deaa7757 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:29.132907 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 146/296] 10.222.0.27 () {58 vars in 1463 bytes} [Wed Oct 12 14:26:29 2022] PUT /identity/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c/groups/d26b94603faa42adaaf823e3a2ed1eac/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:29.897575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448436-59eb-4097-ae41-545535052a15 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.897948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448436-59eb-4097-ae41-545535052a15 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.898134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98448436-59eb-4097-ae41-545535052a15 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.899742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 151/297] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:29.904806 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ae6f-287a-4a21-86c8-86c1713ba504 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:29.905097 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ae6f-287a-4a21-86c8-86c1713ba504 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:29.905375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331ae6f-287a-4a21-86c8-86c1713ba504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:29.931224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a331ae6f-287a-4a21-86c8-86c1713ba504 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:29.932429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a331ae6f-287a-4a21-86c8-86c1713ba504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:30.023754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 147/298] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:30.114646 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dae31-7170-4466-ae20-58755d7e42f8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:30.115263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dae31-7170-4466-ae20-58755d7e42f8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:30.115263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dae31-7170-4466-ae20-58755d7e42f8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:30.116746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 152/299] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:30.122021 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:30.122338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:30.122613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:30.144991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:30.146193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:30.219518 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:30.227901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 148/300] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:30.370911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dae31-7170-4466-ae20-58755d7e42f8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:30.498783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dae31-7170-4466-ae20-58755d7e42f8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:30.537686 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:30.538404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:30.538689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:30.538963 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:30.549979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:30.555637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:30.556719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:30.557506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 153/301] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:30.564862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:30.688023 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5befc7-4939-4214-bf88-23b98ec28517 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:30.726301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:30.726911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:30.727197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:30.727468 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:30.728123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:30.728422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:30.729797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:30.738700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 149/302] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:30.744150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:30.782672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:30.871875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de9b17-3958-40d5-a57a-a7e41a028a39 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:30.881323 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:30.929391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:30.930602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:30.931124 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:30.931584 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:30.959417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.014463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8688a8-a0d5-44fa-8fcf-310daf6f582d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.024139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.025633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95a25d-5b77-4036-b41f-2d0711ce2160 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.065893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.067187 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.067644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.068020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.083684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:31.084265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-55cadec3-0080-4f58-b533-d6117f931a65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:31.089286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:31.090167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:31.091001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 150/303] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:26:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:31.092510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b0b9-739e-42ff-9598-57be8133b927 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.092867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b0b9-739e-42ff-9598-57be8133b927 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.093264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b0b9-739e-42ff-9598-57be8133b927 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.094698 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 151/304] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:31.099640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59b0b9-739e-42ff-9598-57be8133b927 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.171870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 154/305] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:31.172973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.173253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.174119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.206562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:31.208712 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:31.220222 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59b0b9-739e-42ff-9598-57be8133b927 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.245369 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.261035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.261647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.261922 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.266193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.266193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:31.266193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.266193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.275840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 152/306] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:31.276768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.310119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 155/307] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:31.311329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.390904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.438098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d24a5e-f598-412b-bdbd-ef250bfc89f5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.477150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c6ce-1add-494e-ac1a-e1da9e3d7610 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.481754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.482700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.483294 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.483775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.535861 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.536510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.536797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.537053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.538436 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.539884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb365d9-505c-4268-87dc-8a255b13e31a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.542384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 153/308] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:31.543706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eae6-6026-49fd-9e7e-e36870b3ed4c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.543997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eae6-6026-49fd-9e7e-e36870b3ed4c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.544270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93eae6-6026-49fd-9e7e-e36870b3ed4c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.545540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 154/309] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:31.553065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93eae6-6026-49fd-9e7e-e36870b3ed4c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.569970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.571454 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c029e58-a838-4bf6-8bcd-29d77db74b74 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.617581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.651385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.683566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93eae6-6026-49fd-9e7e-e36870b3ed4c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.700415 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 156/310] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:31.702111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.702664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.703126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.725657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.728751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.728751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.728751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.728751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.729042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:31.729843 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.729953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:31.731022 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 155/311] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:31.731783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.818266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 157/312] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:31.819317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.871043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751eae6-fd2f-40a1-85f1-fd6bfb5d94e6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.892768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.913065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.913348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.913631 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.913899 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] PATH_INFO: `/v3/projects/ada28e826b664a92bc196ccac52c6a32` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:31.915051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] RBAC: Authorizing `identity:get_project(project_id=ada28e826b664a92bc196ccac52c6a32)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:31.916486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:31.918831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 156/313] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/projects/ada28e826b664a92bc196ccac52c6a32 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:31.919474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:31.944327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:31.953199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb443-6d36-43cd-a732-26c9aa254dac None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:31.996053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:31.997459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:31.997911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:31.998563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.013080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:32.019034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:32.019906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 14:26:32.020698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:32.023357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 158/314] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:32.024280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.055993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04889d33-843a-4090-9e24-26b8e928f111 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.107318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.108093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.108461 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.108821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.109914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] RBAC: Adding query filter params (group.id=9bcbd8acdc4c4809a7979d20eb85a08c, role.id=0758c64a8e384ccda9eb5443f4a87c6b, scope.project.id=ada28e826b664a92bc196ccac52c6a32) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:32.110064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.111943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.119405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 157/315] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 12 14:26:31 2022] GET /identity/v3/role_assignments?group.id=9bcbd8acdc4c4809a7979d20eb85a08c&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:32.120358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.177948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8ef57-eb89-4a8f-8b47-fb57d337aa58 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.198064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.219050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.219720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.220688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.220978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.222197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.223712 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.225370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 159/316] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:32.226202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.262249 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a1bc-5cbb-42d5-8f1d-b641745c18b6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.266062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.319815 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.320442 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.320725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.321002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.322309 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] RBAC: Adding query filter params (name=member) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:32.322309 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.324620 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043025f3-dd77-4c76-b7df-ade22448aece None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.332753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 158/317] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:32.333993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278b1d-0f2d-4b53-9256-617b1517b372 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.335067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278b1d-0f2d-4b53-9256-617b1517b372 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.335067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f278b1d-0f2d-4b53-9256-617b1517b372 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.335911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 159/318] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:32.336475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278b1d-0f2d-4b53-9256-617b1517b372 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.374297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e109fe-a7df-4052-a7bf-f16f1d21cd52 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.416410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.417041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.417318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.417585 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.430835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:32.435929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:32.436841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:32.437622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 160/319] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:32.438335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.474900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f278b1d-0f2d-4b53-9256-617b1517b372 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.492385 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.521645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.522293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.522574 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.523230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.523948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] RBAC: Adding query filter params (group.id=9bcbd8acdc4c4809a7979d20eb85a08c, role.id=e7fae3c65ae44410ade680c055bb291f, scope.project.id=ada28e826b664a92bc196ccac52c6a32) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:32.524259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.525698 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba193ce-ef76-4cd0-88ba-a1d981d1e45b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.534238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 160/320] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/role_assignments?group.id=9bcbd8acdc4c4809a7979d20eb85a08c&scope.project.id=ada28e826b664a92bc196ccac52c6a32&role.id=e7fae3c65ae44410ade680c055bb291f => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:32.534711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.535435 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.535959 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.536061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.554889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536855eb-f30c-4a0d-b78d-61fa03817779 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.556897 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:32.558157 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:32.605316 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.605948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.607304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.607304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.652973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 161/321] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:32.654449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.704252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.705905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.797198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f1986-6a81-40b7-9010-76963acf5940 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.805439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.818782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:32.843081 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 161/322] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:32.847976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:32.848831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:32.849046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.849147 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:32.849358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:32.850019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:32.850368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:32.851745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:32.860478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 162/323] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:32.866412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:32.967934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656927-da95-4533-ab0e-962994bdea97 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:32.998223 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a3b20-bac7-43ea-8bb7-95d5038cb755 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.013783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.014468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.014751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.015028 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.016155 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.018152 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.020980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 162/324] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:33.021746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.039996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.040656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.040939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.041206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.081110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.081658 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.123009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.124450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.137880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a8c6b-3a99-4076-96d3-eeb19002eabd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.179781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.180458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.180817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.181087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.192743 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:33.197623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:33.198682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:33.199519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 163/325] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:33.200174 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.246051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 163/326] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 12 14:26:33.246051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.317451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4795f-665f-45f4-a82a-10356334e15b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.328276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.333120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.360216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.360877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.361160 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.361429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.363027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.364002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.366827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 164/327] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:33.367485 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.369851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d8f0-9e9b-4eb8-8e64-461f52bd5481 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.405550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.406150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.406458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.406725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.407898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:33.408205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.409554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.417399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 164/328] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:33.418247 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.471752 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a1c4d-328f-4b51-bbdc-ad3b2f58be9c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.505575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.506129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.506434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.506702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] PATH_INFO: `/v3/projects/c278a677c48b41e48007151a067076ab` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.507809 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c278a677c48b41e48007151a067076ab)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.509233 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.510874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 165/329] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/projects/c278a677c48b41e48007151a067076ab => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:33.511621 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.515498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dfa68-50cf-40f7-a30a-8c7a9505f9e0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.543299 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.551350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.551950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.552232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.552497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.553216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] RBAC: Adding query filter params (group.id=9bcbd8acdc4c4809a7979d20eb85a08c, role.id=0758c64a8e384ccda9eb5443f4a87c6b, scope.project.id=c278a677c48b41e48007151a067076ab) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:33.553518 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.554961 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.560984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 165/330] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/role_assignments?group.id=9bcbd8acdc4c4809a7979d20eb85a08c&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=0758c64a8e384ccda9eb5443f4a87c6b => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:33.561746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.561930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.625854 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaca950-506d-49fa-b163-78f42f6421e5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.665280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.665909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.666215 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.666489 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.676377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfcff3-9dc3-4a43-b03a-a7e9fd9eaf47 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.714284 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.714934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.715217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.715490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] PATH_INFO: `/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.716631 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] RBAC: Authorizing `identity:get_group(group_id=9bcbd8acdc4c4809a7979d20eb85a08c)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.718117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.720326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 166/331] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/groups/9bcbd8acdc4c4809a7979d20eb85a08c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:33.726211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.743908 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.745901 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.801511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.802307 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:33.850106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc42547-8494-4f27-ad38-5dc8c5790e72 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:33.867348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 166/332] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:33.873330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:33.887867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:33.888917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:33.888917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:33.889189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:33.889917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] RBAC: Adding query filter params (group.id=9bcbd8acdc4c4809a7979d20eb85a08c, role.id=e7fae3c65ae44410ade680c055bb291f, scope.project.id=c278a677c48b41e48007151a067076ab) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:33.890301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:33.892654 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:33.899581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 167/333] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/role_assignments?group.id=9bcbd8acdc4c4809a7979d20eb85a08c&scope.project.id=c278a677c48b41e48007151a067076ab&role.id=e7fae3c65ae44410ade680c055bb291f => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:33.988302 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892e8f9-8b16-44db-986a-e35a4519d8d6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:34.027597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:34.028257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:34.028540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:34.028818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] PATH_INFO: `/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:34.029995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] RBAC: Authorizing `identity:get_project(project_id=12a7cca3f1ca479292dd1f33c68bdb7c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:34.031486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:34.033191 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 167/334] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:26:33 2022] GET /identity/v3/projects/12a7cca3f1ca479292dd1f33c68bdb7c => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:34.039039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:34.140388 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b715b38-dd2a-4bbb-9db5-77c7661727b9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:34.165774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:34.174711 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:34.175340 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:34.175615 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:34.175884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] PATH_INFO: `/v3/groups/d26b94603faa42adaaf823e3a2ed1eac` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:34.176971 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] RBAC: Authorizing `identity:get_group(group_id=d26b94603faa42adaaf823e3a2ed1eac)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:34.178439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719565c-76fa-495e-9efe-aadbdc76c751 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:34.179990 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 168/335] 10.222.0.27 () {56 vars in 1180 bytes} [Wed Oct 12 14:26:34 2022] GET /identity/v3/groups/d26b94603faa42adaaf823e3a2ed1eac => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:34.185946 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:34.205916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:34.288178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04f266-7d9c-4612-8e96-cdf23599d364 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:34.321796 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:34.322428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:34.322710 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:34.322983 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:34.323699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] RBAC: Adding query filter params (group.id=d26b94603faa42adaaf823e3a2ed1eac, role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=12a7cca3f1ca479292dd1f33c68bdb7c) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:34.324009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:34.325434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dba3b5-7460-4060-b710-a9466d50c874 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:34.331075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 168/336] 10.222.0.27 () {56 vars in 1376 bytes} [Wed Oct 12 14:26:34 2022] GET /identity/v3/role_assignments?group.id=d26b94603faa42adaaf823e3a2ed1eac&scope.project.id=12a7cca3f1ca479292dd1f33c68bdb7c&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:36.811524 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcfa9a-855c-4767-bb4e-ed4b8ae031b5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:36.812141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcfa9a-855c-4767-bb4e-ed4b8ae031b5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:36.812141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcfa9a-855c-4767-bb4e-ed4b8ae031b5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:36.813445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 169/337] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:36.818952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ccb6a-0b38-48b0-9a8e-b0851de3c674 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:36.819760 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ccb6a-0b38-48b0-9a8e-b0851de3c674 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:36.820235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ccb6a-0b38-48b0-9a8e-b0851de3c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:36.846771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-642ccb6a-0b38-48b0-9a8e-b0851de3c674 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:36.848296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-642ccb6a-0b38-48b0-9a8e-b0851de3c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:36.934806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 169/338] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:37.205707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57306ee-5cab-4363-b97c-31909d2f275e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.206414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57306ee-5cab-4363-b97c-31909d2f275e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.206899 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57306ee-5cab-4363-b97c-31909d2f275e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.208433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 170/339] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:37.213590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.214085 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.214592 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.239102 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:37.240638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:37.243810 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:37.258089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf64ac-2712-4d74-a0b5-e66990655d43 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.258662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf64ac-2712-4d74-a0b5-e66990655d43 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.259138 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf64ac-2712-4d74-a0b5-e66990655d43 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.260942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 171/340] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:37.266679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.267294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.268016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.298751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:37.305168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:37.346980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 170/341] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:37.347953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:37.376907 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 172/342] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:37.455265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e004c3e-878b-4ad5-b13f-92d23dd6df44 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:37.491273 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:37.491819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.492090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.492361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.500875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:37.503271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:37.505492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:37.521144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:37.522318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:37.523398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:37.523398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:37.523398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:37.525033 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 171/343] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:37.532131 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:37.668867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cae35d-6417-46c4-be0c-dcbc8012f0d1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:37.702129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:37.713745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:37.720245 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:37.720863 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.721140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.721473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.722120 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:37.722444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:37.723802 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:37.746491 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 173/344] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:37.755226 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:37.867766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7aa3a8-767c-4fc6-b282-9ba04fbe98ff None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:37.905618 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140da01-f653-4f37-9e61-e863b0becd0f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:37.913285 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:37.914021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.914399 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.914765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.926006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:37.927563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:37.942853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:37.943463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:37.943738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:37.943845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:37.944668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:37.946047 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:37.946047 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:37.946047 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:37.946510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:37.946510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:37.946716 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 172/345] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:37.946824 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:37.950802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:37.971541 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 174/346] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:37 2022] POST /identity/v3/users => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:37.972612 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.021367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.038870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.090674 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4142c-35b0-41d5-94db-d12319d41459 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.113907 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f84d33-8635-4020-b7a6-f81a87ff4478 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.141898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.143484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.144458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.145248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.157011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.157644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.157918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.158202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.158870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:38.159170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.161301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11beee7e-1047-46ef-ab2f-44e59f5aa405 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.161955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.164501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.176625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 175/347] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:38.178000 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac9b-899a-473d-a9dd-f0c7845a62cb None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.178331 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac9b-899a-473d-a9dd-f0c7845a62cb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.178608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ac9b-899a-473d-a9dd-f0c7845a62cb None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9170222b-e3aa-4150-99ce-63464aaa7d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:38.183193 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:38.184107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:38.184940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:38.184940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:38.184940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:38.185111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 176/348] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:38.185183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 173/349] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:38.185255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ac9b-899a-473d-a9dd-f0c7845a62cb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.186008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.186008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.189231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.211279 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:38.212490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:38.291824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 174/350] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:38.292830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.324129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.336418 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238ac9b-899a-473d-a9dd-f0c7845a62cb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.348013 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.419795 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.420419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.420695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.420962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.421607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.423612 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25819a-52cd-4d62-b2ad-7f57695e0f1a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.446383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12857f93-25bb-4d22-9ddc-7e16ac7189a2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.462342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 177/351] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:38 2022] POST /identity/v3/users => generated 248 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:38.464333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4daf6-74bc-4333-8b3d-680b9580e077 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.464820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4daf6-74bc-4333-8b3d-680b9580e077 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.465396 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4daf6-74bc-4333-8b3d-680b9580e077 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.472178 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 178/352] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:38.474401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.474686 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.474959 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.488532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.489520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.490672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.491116 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.492203 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:38.492690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.494281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.495665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:38.497324 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:38.521018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 175/353] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:38.530486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.628560 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 179/354] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:38.629635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.704950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.729133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3f9fc-35d7-40db-bfa2-019dfbecf9e7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.747804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:38.772619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c9ec-0a94-4394-8b3b-86409099f126 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:38.774699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.775331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.776396 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.776672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.777329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.778832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.806318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 176/355] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:38 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:38.825515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:38.826555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:38.827046 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:38.827584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:38.843305 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:38.845786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:38.869115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:38.870081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:38.871359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:38.871359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:38.871359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:38.873297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 180/356] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:38.879680 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:38.911421 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:39.045723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721e57-9616-43f2-8c46-1c6bd719c351 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:39.096121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:39.096744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:39.097026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:39.097294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:39.098511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:39.100180 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:39.101162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eafac31-a236-407a-80f8-a638ec8cd772 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:39.113123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.sql.core [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 14:26:39.113123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 14:26:39.113123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [parameters: {'id': '914da670d08345c4962318e044d90768', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 14:26:39.113123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:26:39.121891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return ref.to_dict() Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:26:39.122827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application yield resource Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise self.value Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application session.commit() Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 14:26:39.123766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.flush() Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application compat.raise_( Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 14:26:39.124645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:26:39.125590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:26:39.126563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [parameters: {'id': '914da670d08345c4962318e044d90768', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:39.127343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 14:26:39.128124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.133974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 181/357] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 12 14:26:38 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:39.133974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:39.133974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:39.162343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:39.163323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:39.163823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:39.164296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:39.165151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:39.165662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:39.167325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:39.188298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 177/358] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:39.193304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:39.202618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:39.319156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60602-0c7c-4a95-8e97-8bdeec201d08 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:39.351457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae081-21c6-4012-ab15-38dfced2adca None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:39.389211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:39.389775 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:39.390052 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:39.390350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:39.410420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:39.415976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:39.416859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 14:26:39.417661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:39.418327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 182/359] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:26:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:39.427107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:39.438050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:39.439086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:39.439571 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:39.440039 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:39.440901 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:39.442599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897945a-2d13-45f7-b179-6f49ebdef988 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:39.484104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 178/360] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:39 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:26:39.495570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:39.538592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7136393-fd1a-4cce-8997-633a5894107d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:39.575272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:39.575893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:39.576174 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:39.576447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:39.577115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:39.577415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:39.578898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad32843-6079-4f42-a6cd-bb9a6fc543b2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:39.587932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 183/361] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:40.607873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f724-652e-4935-ac21-e541c9c1953f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:40.608414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f724-652e-4935-ac21-e541c9c1953f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:40.608414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1f724-652e-4935-ac21-e541c9c1953f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:40.610757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 179/362] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:40.616222 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381a1a-dc7c-41d7-8e00-f3225e76e943 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:40.617078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381a1a-dc7c-41d7-8e00-f3225e76e943 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:40.617566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381a1a-dc7c-41d7-8e00-f3225e76e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:40.646375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f5381a1a-dc7c-41d7-8e00-f3225e76e943 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:40.647896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f5381a1a-dc7c-41d7-8e00-f3225e76e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:40.744788 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 184/363] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:41.032626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1f724-652e-4935-ac21-e541c9c1953f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.091656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a69bfa-a2c1-4401-9544-ed135ff9a05a None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.091975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a69bfa-a2c1-4401-9544-ed135ff9a05a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.092201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a69bfa-a2c1-4401-9544-ed135ff9a05a None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.094080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 185/364] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:41.098976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.099256 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.099513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.112050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:41.120753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:41.122217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:41.199758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1f724-652e-4935-ac21-e541c9c1953f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:41.204481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:41.238629 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 186/365] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:41.267227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:41.268215 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.268706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.269178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.287072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:41.292393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:41.293250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:41.294046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:41.297261 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 180/366] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:41.303210 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.449134 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e1878-4b60-418c-b773-5a10b7a3517a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:41.498337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:41.499319 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.499896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.500374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.501224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:41.501745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:41.503350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4e0c0-d67f-453d-921a-3599436d3941 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:41.511766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 187/367] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:41.518389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.609410 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032b56-ab2e-448f-b01e-84b72b7daa61 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.609756 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032b56-ab2e-448f-b01e-84b72b7daa61 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.609957 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d032b56-ab2e-448f-b01e-84b72b7daa61 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.611461 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 188/368] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:41.617098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.618051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.618545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.639320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:41.641069 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:41.648313 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829441e3-e9b3-47ac-8382-e5f1295dc7dc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:41.678082 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:41.687151 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:41.690837 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:41.691871 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.692355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.692905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.705575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:41.707248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:41.718673 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 189/369] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:41.719860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:41.723943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:41.726602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:41.727437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:41.727437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:41.727437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:41.727437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 181/370] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:41.732338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.852363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521204c1-32e1-45b9-bcaa-b76234db4b98 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:41.888781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:41.889392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:41.889777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:41.890108 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:41.890790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:41.891090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:41.892740 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:41.906143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 182/371] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:41.917399 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:41.952574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:41.974898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503243d-8bfb-4c92-90ee-b216bfca20de None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.031944 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b050-193f-4b2f-b648-abc7ffa8e16b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.040517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.041422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.041943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.042450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.055150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:42.061496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.062506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:42.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:42.064696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 190/372] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.064696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.070973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.071239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.071505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.071774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.080086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.081543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:42.095484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.096452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 183/373] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:26:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.098099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.110670 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.188006 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400440d-32b7-489e-a316-648ee2a9ed0e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.197330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.208704 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1b0e3-ca5c-45ce-a4e2-f9d9aa9b6523 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.231503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.232830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.233324 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.234459 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.249001 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.249727 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.250010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.250267 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:42.250384 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.251022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:42.251328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.252813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:42.257438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.258466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:42.259339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:42.268455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 184/375] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:42.268455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.268847 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 191/375] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.270481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.379194 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.385112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081ba21-1f58-421e-b9c7-1db908ca2230 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.387989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869f683-cb24-4bc4-8fcc-f33a764ef8bf None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.418464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.419060 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.419333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.419607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.420252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:42.420547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.421678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.421900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.422314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.422595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.422867 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.423585 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:42.423891 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.425326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f5abb-36d0-4bf4-b41e-193700d32de1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.429438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 192/376] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:42.430236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.463355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 185/377] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:42.464600 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044659-4e8c-4bbf-a881-bdf731727a7b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.464884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044659-4e8c-4bbf-a881-bdf731727a7b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.465158 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da044659-4e8c-4bbf-a881-bdf731727a7b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.466390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 186/378] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:42.467402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b25f3-720a-4001-b26e-0c9840376f09 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.467680 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b25f3-720a-4001-b26e-0c9840376f09 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.468098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b25f3-720a-4001-b26e-0c9840376f09 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.469147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 187/379] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:42.469838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b25f3-720a-4001-b26e-0c9840376f09 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.482446 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.537720 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b37e8a-93b0-466c-b973-4bf5aa084b8e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.571470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.572104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.572384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.572652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.573384 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b25f3-720a-4001-b26e-0c9840376f09 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.583009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.584454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:42.598770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.599736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:42.600625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:42.600625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.600625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:42.600625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 193/380] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.600625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.609915 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.610588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.610861 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.611131 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.613937 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.621339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.622842 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-14c48be8-0d8d-44f4-9fc9-ea0e301aad9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:42.638040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.639090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 188/381] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148788-b76d-43ad-9de5-ea6c1d6cb236 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148788-b76d-43ad-9de5-ea6c1d6cb236 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.642048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79148788-b76d-43ad-9de5-ea6c1d6cb236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.659433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-79148788-b76d-43ad-9de5-ea6c1d6cb236 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:42.660627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-79148788-b76d-43ad-9de5-ea6c1d6cb236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:42.702292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fc3e6-8f27-43bb-b0e4-389696ca7374 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.715824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.735017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 189/382] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:42.735017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.735017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.735017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.743964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.744598 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.744878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.745172 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.750068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:42.751295 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:42.756683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.758142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:42.772850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:42.773768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:42.774665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:42.774665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:42.774665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:42.774665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 194/383] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:42.774880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.834212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 190/384] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:42.834212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.842757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:42.887111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94feddb1-a2ed-4b96-9f7f-0cbd71cb4e4f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.923754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:42.924525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:42.924903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:42.925338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:42.926065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:42.926484 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:42.927983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:42.942563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 195/385] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:42.944699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:42.962928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261182-1017-49c0-8d86-0dbb5a0e1c2e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:42.986590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.002200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.002843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.003120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.003489 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.004133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.004431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.006218 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.018311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.023332 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.069906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8b53-e444-4186-8e16-a8c86b126993 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.093971 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.106301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.106926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.107220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.107483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.108154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.108483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.109846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.121415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 196/387] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.122234 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.125196 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de6a3c-f2e1-4b82-8590-31d2910e27d6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.158643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.159358 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.159638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.159907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.167204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.168648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:43.179618 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.185324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 192/388] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.186462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.223565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4074e8-b296-47d2-a373-f48c008dad79 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.226608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.257119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.257742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.258025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.258338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.269288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:43.274570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.275486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:43.276283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 197/389] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.276941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.286468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2f22d-aab6-4fa0-a0a3-0992970fd2fc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.319650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.320275 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.320431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.320540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.320808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.329130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.330600 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:43.341576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.342580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 193/390] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.343994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.380097 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19552118-e2f2-4c3c-8fb7-c466f5ebdb8d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.413050 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.413664 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.413943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.414241 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.424462 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.425893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:43.439988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.440869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:43.441738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:43.441738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:43.441738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:43.441738 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 198/391] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.441950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.446927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819309af-f0f6-4028-9bd1-00bbdb310c85 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.448478 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.482660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.483800 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.484098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.484359 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.490949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.492388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:43.504130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.505146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 194/392] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.506022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.536739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.543280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366ed1b-8b6e-4f7f-b767-bcd16a72b5c6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.576165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.576759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.577565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.577835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.578585 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.578880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.580278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.608230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea986c-6587-4be1-8db0-e2f98c2fe189 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.615783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 199/393] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.616580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.641274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.642126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.642449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.642723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.643383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.643687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.645079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.652813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 195/394] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.653597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.678533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.722071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78ee24-7f53-4049-9b6c-3d3f5fc39315 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.752623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba646fa-2f93-4785-9e52-6c409060cae7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.754056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.754681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.754966 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.755234 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.755950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.756252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.757680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.778292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 200/395] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.778292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.786742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.787337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.787610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.787875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.788510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.789074 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.789687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.790492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.803309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 196/396] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.804088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.876337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaff71-dd4a-4f3b-95cc-3b932a4309d9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.886083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:43.903483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbbab5-482c-4ee1-b74c-d1f29d348e98 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:43.910473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.911072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.911351 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.911622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.912304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:43.912608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.914034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.930933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 201/397] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:43.931804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:43.937032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:43.937655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:43.937928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:43.938226 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:43.948181 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:43.949614 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:43.964439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:43.965309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:43.966408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:43.966408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:43.966408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:43.966408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 197/398] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:43.966652 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.009388 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.041270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cf1be-6d08-4815-a41f-bf7cad431a1f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.067298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccc536-f1be-4b11-915b-1bfc6f9dcb9a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.074028 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.074684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.074970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.075243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.085557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.087054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.100213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.100834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.101114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.101387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:44.101906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:44.102985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:44.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:44.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:44.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:44.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 202/399] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:44.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.106531 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.115259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.116707 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:44.131272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:44.132333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:44.133381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:44.133381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:44.133381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:44.133381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 198/400] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:44.133381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.206513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716ee7e-9516-4dec-8a6f-dc28ac48eef9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.227701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.231756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a345be8-95c0-4f6a-ab6a-2cb3b6ac8d2c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.240342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.240952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.241233 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.241508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.242148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.243635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.270230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 203/401] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:44 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:44.270431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.270431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.270431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.270431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.275365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.284572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=4ae307c1cb064d0cb4b8b61cc5fe13d3, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.286238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.310216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 199/402] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:44 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:44.310216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.370656 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.424905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf97d3-cac7-4a47-8c87-4b51698e1ae3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.452894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dca478-9eb2-4bd3-ad15-c0cc0a17397f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.473100 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.473740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.474019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.474386 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.475163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:44.475476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.476888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.490958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 204/403] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:44.491742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.496648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.497686 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.497686 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.497856 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.499507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:44.499507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.500402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.517234 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 200/404] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:44.518518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.550299 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.616830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b2eaa-11a5-4c32-8315-6ed2a2eaba98 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.652988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.653420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.653715 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.653971 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.654690 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:44.655521 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.657174 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.657352 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.662375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce404-c050-4b28-ba86-5a4a602be989 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.681463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 205/405] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:44.682668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.708248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.710000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.710452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.711128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.721519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.723274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:44.737756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:44.738658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:44.739634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:44.742896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 201/406] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:44.743869 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.800410 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:44.805840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380961f-ebdb-45b8-96ec-a4d80f69c9eb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.843688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.844475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.844841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.845179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.853660 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.855154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.860006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d9658-54a7-4556-8ffc-1e25a4850c0b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:44.869297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:44.870311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:44.871220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 206/407] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:44.871809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.901518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:44.902558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:44.902978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:44.903413 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:44.911241 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:44.912967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:44.925378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:44.926282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:44.927144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:44.929205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 202/408] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:44.930114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:44.951041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.002015 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f480f-41b5-4c41-b9fc-59302b551d0e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.048400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.049202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.049579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.049947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.050827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:45.051171 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.052926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.061167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4253067-3a12-472b-bc27-a2f39483cf2a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.066424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 207/409] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:45.071161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.092102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.109420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.110274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.110956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.111370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.113130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:45.113583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.115183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.139754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 203/410] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Oct 12 14:26:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:45.141413 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.182205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4730796-0835-4078-97a1-6997a8217554 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.228760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.229664 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.230125 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.230571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.231485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:45.231952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.234500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.237477 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.251516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 208/411] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:45.256405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.279344 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264217-0217-4fb4-b6a6-ae3d0a25096f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.325747 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.327183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.327844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.328269 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/9cd9f8c45f0743579418354966a74ff3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.337710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.348314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=9cd9f8c45f0743579418354966a74ff3, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.350497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.363390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a860074-0746-4dd1-8559-7cd3596031b3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.367535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 204/412] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:45 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/9cd9f8c45f0743579418354966a74ff3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:45.368453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.435017 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.435836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.436811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.437253 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.458214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.459954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:45.483601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:45.484774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:45.485870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:45.485870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:45.485870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:45.493151 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 209/413] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:45.493749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6143b-65d4-4332-9bc2-c9d74e81112b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.499173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.526683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.539870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.541361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.541796 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.542258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/fd11abedcea148cd863b25261a0b37e3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.563328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=fd11abedcea148cd863b25261a0b37e3, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.565259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.588982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 205/414] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:45 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/fd11abedcea148cd863b25261a0b37e3/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:45.676351 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eadf3d-cb07-42e6-a404-9051005442cc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.711419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:45.726970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.727948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.728423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.728881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.729729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:45.730295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.731909 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.747071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 210/415] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:45.754099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:45.881030 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f19c5-9e26-448c-b996-1c756484fe4d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:45.917386 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:45.918023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:45.918334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:45.918608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:45.927843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:45.929297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:45.941173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:45.942014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:45.942876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 206/416] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:45.948061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:46.085329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9b3ee-e3f5-4672-9deb-4c6b3f407473 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:46.135045 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:46.135934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.136394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.136852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.137704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:46.138216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:46.139902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e945ea0-6ba3-49ea-aaba-08c0f44ade1e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:46.153930 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 211/417] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:46.162235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:46.220113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:46.301358 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f1c0-97fe-4587-abeb-8db7dd6ddadc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:46.337125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:46.337786 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.338065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.338367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/1342faa2ddc741ad9f0f5122041b209b/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.360742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=1342faa2ddc741ad9f0f5122041b209b, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:46.362290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c979b7-5cef-4647-9b67-cd3908edff3d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:46.379431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 207/418] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:46 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/1342faa2ddc741ad9f0f5122041b209b/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:46.694606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66e80-2761-4f2e-9dd2-3d1901f20a09 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.694945 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66e80-2761-4f2e-9dd2-3d1901f20a09 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.695160 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d66e80-2761-4f2e-9dd2-3d1901f20a09 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.696841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 212/419] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:46.703049 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.703341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.703615 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.722147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:46.723395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:46.791190 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d816-d2be-4357-8eba-bb227ff63605 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.791765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d816-d2be-4357-8eba-bb227ff63605 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.792112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0d816-d2be-4357-8eba-bb227ff63605 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.793916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 213/420] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:46.799932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:46.800473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:46.800963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:46.802766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 208/421] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:46.821597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:46.822832 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:46.882927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:46.909270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 214/422] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:47.275025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.300184 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:47.369251 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.434838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9954d7-2e07-4ce7-bc0b-ca32d909533a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:47.504010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:47.504999 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:47.505544 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:47.506793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:47.525375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:47.531765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:47.532622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:47.533390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:47.539017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 209/423] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:47.541932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c69fa9-a148-4c3e-a808-6de098d276a5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:47.545854 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.592579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:47.593570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:47.594040 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:47.594553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:47.605735 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:47.611146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:47.612029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:47.612828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:47.620021 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 215/424] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:47.621570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.668216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:47.699118 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:47.745794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4e53-eb8d-44a4-a042-61332ea2d4b5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:47.777811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c02ca6-71ea-402d-9122-fd4e3e3ccaa6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:47.812610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:47.814116 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:47.815406 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:47.816541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:47.817556 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:47.819088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:47.820857 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:47.837643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 210/425] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:47.838557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:47.839378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:47.839872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:47.840326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:47.841263 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:47.842841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.843350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:47.845004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:47.861368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 216/426] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:47.877201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:47.999382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e068a-854d-4c0d-a2fa-8658805a77a9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.049111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.049679 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.049953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.054367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.070593 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.078421 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb303df-f1ee-42f4-b26b-13f58daa43f3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.081847 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.082381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.083853 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:48.115024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:48.115985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:48.116807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:48.116807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:48.116807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:48.119336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 211/427] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:48.127002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.152272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.154045 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.154462 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.154735 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.167851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.169314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-7f7fc63a-55ff-4f2e-a3dc-794d634c5627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:48.184617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:48.185586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:48.187179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:48.187179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:48.187179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:48.187179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 217/428] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:48.191917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111374d1-0e68-46e6-8c7b-d84ff5bf22ae None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.192238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111374d1-0e68-46e6-8c7b-d84ff5bf22ae None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.192510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111374d1-0e68-46e6-8c7b-d84ff5bf22ae None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.193913 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 218/429] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:26:48.194473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111374d1-0e68-46e6-8c7b-d84ff5bf22ae None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.293374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162d882-26ae-40e4-b424-f3dad6028964 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.311158 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111374d1-0e68-46e6-8c7b-d84ff5bf22ae None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.329021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.329684 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.329964 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.330346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.330894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:48.331200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.332574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb13b6-49fb-44e2-a055-bdec648da90e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.346617 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 212/430] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:48.351590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.352014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.352300 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.352397 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.352558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.352663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.352996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.353701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:48.354062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.355506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb8d12-5aed-4dfa-abfd-d43014e45924 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.368674 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 219/431] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:48.369941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:48.370059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9474da-afc8-4c2e-8c2a-dbe85bad501c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.370539 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9474da-afc8-4c2e-8c2a-dbe85bad501c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.370612 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9474da-afc8-4c2e-8c2a-dbe85bad501c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.371175 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:48.372041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 220/432] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:48.373455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9474da-afc8-4c2e-8c2a-dbe85bad501c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.392033 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.425287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.448638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 213/433] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:48.449501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.500525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9474da-afc8-4c2e-8c2a-dbe85bad501c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.547264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.547898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.548172 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.548439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.559549 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.561941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.568899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093aa9a-0653-42db-a581-ab6633d7fc04 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c6e8d885-fdf6-4c75-a7aa-1728cd367a77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:48.576181 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:48.577056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:48.577933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:48.582140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 221/434] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:48.583611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.583869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.584212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.602767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:48.604155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:48.614426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.615766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.616217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.616659 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.626918 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.629115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:48.646053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:48.646972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:26:48.647938 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:48.650919 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 214/435] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:48.652347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.693514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 222/436] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:48.693514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.695813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.710645 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.782373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fe19e-6a03-4622-bf23-b9ba74598799 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.827147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.827767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.827973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.828209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.828943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:48.829245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.829629 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18862357-df22-4e81-9594-202dd5f44e18 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.830843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 215/437] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:48.851569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.872601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.873278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.873555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.873828 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:48.874647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:48.874948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:48.876513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:48.897127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 223/438] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:48.897974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:48.956452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.960529 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94d7b-c62d-48a9-b60f-b5036393e2b3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:48.967110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:48.997006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:48.997632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:48.998504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:48.998780 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.008978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:49.010583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd35d01-d7ef-467d-8d97-de6edde17b19 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:49.013811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.014892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:49.016136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:49.020059 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 216/439] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.020882 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.047422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.048033 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.048310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.048584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.114928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.116314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.120072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd12994-389e-420f-a4a2-031560e8e029 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.154604 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.155211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.155491 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.155755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.165392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.166866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.174341 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-71862a98-52e9-452e-a88a-9efc3c0c800e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:49.182027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.182954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:49.183805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:49.183805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.183805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:49.183805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 217/440] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.184586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336fbdb-4da9-4c40-b966-fa8145386eb4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.184867 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336fbdb-4da9-4c40-b966-fa8145386eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.185163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336fbdb-4da9-4c40-b966-fa8145386eb4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.187040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 218/441] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:49.187596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336fbdb-4da9-4c40-b966-fa8145386eb4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.199767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.218813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 224/442] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:49.219712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.290461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336fbdb-4da9-4c40-b966-fa8145386eb4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.318384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5297a4b-1e7e-4c85-8df9-bde393d62154 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.323613 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.324245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.324527 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.324802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.334835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:49.340106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.340962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:49.342301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 219/443] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.343369 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.351957 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.352567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.352847 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.353119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.353776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:49.354076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.355472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc5ac2-a607-4f1b-9156-f5f91ef1936b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.363503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 225/444] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:49.364676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.365012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.365234 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.382949 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:49.384149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:49.401804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.415268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.446619 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1450a-e8fe-49ea-8340-c4eea4ea1f6f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.450783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 226/445] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:49.451602 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.479715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.480317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.480597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.480873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.481507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:49.481808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.483289 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.499449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 220/446] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:49.499449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.570890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ab247-07e8-4de9-a07a-28bb7ae81cb4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.602759 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f07d03-ce5e-494f-be38-b0d833639616 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.605757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.606421 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.606706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.607525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.617805 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.619237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.632309 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:49.633563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.634842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:49.635737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:49.635737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.635737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:49.639898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 227/447] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.640987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.642858 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.643472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.643751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.644023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.644687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:49.644991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.646427 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.650297 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.660008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 221/448] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:49.660008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.751254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e4ae3-8c81-43de-ae02-f488e486d965 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.756365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdb520-0260-45a8-9795-0a7da70f05a6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.783570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.784210 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.784494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.784766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.788637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.789261 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.789540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.789807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.795680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.796898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.797204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.798359 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:49.809365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.810437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:49.811334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 222/449] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:49.811791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.812619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:49.813804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:49.813804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.813804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:49.813973 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.814042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 228/450] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.814042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.864930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.871405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:49.913906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596385-cfb0-4147-aa0d-2595bc1227d8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.914064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d36c-4442-450d-8d72-b14adfca9a2a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:49.946648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.946794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:49.947271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.947371 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:49.947540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.947633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:49.947811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.947904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:49.948432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:49.948728 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.950420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.958666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:49.960098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:49.962757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 223/451] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:49.963546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:49.976079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:49.976983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:49.977835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:49.977835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:49.977835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:49.977835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 229/452] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:49.978551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.064709 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38967f-cd1d-4303-bd8d-687f76acd05f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.077558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.077688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b624f-2dc1-472b-b6ea-88fb4bb2c853 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.088106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.100756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.101382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.101659 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.101929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.112139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:50.112269 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.112844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.113127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.113403 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.114096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.114434 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.115871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:50.117044 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:50.117979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:50.118990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 224/453] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:50.119981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.134723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 230/454] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.134723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.220870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378993-752c-4270-a769-cbcc9a77b27d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.231712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fe8d6-c448-436a-a3f5-666fe7796939 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.254088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.254713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.254993 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.255265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.255894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.256194 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.257558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.266633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.267248 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.267528 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.267802 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.269409 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 225/455] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.270228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.279374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.280823 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:50.292237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:50.293213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 231/456] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:50.295095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.301689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.328846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.369161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0aaf-0cc5-422b-894c-a767d7a9ca47 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.396776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426b23f-9e8b-4670-b488-25ea390e4886 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.403527 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.404160 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.404436 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.404703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.405337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.405631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.407022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.418246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 226/457] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.418996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.434036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.434675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.435637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.436047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.436707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.437010 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.438409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.446337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 232/458] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.447116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.510804 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.520575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a013c4-5559-4303-9344-49930cfd0a84 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.538400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.547441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481de9-9a40-4261-b759-fb1ab356df55 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.555270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.556368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.556708 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.556988 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4beca14124924c829fd429cef16bd5d8/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.571690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=4beca14124924c829fd429cef16bd5d8, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.573138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.580739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.581359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.581637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.581905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.585300 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 227/459] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:50 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4beca14124924c829fd429cef16bd5d8/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:50.586073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.589380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.590898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:50.603754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:50.604785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 14:26:50.605706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:50.607377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 233/460] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:50.607514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.715042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc569-fefe-449e-b087-36e169107ef1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.729947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063aabd-598b-4ee8-a2c6-fd94f5d096d8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.756732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.757342 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.757613 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.757884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.758604 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.758898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.760343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.770759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.771398 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.771679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.771952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.781221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.782370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 228/461] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.783517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.783623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.785748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:50.798112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:50.799067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 234/462] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:50.800425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.816921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:50.896226 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba70ae-0bbd-4956-96d9-1ae0364be5ae None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.910994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dbde-a99a-4c12-8c0d-c7a33a2748f6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:50.929145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.929912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.930319 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.930685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.941671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.943253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.947077 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:50.947686 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:50.947960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:50.948227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:50.948936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:50.949238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:50.950990 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:50.958268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:50.959360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:50.960387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:50.960387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:50.960387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:50.965173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 229/463] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:50.965937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:50.977024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 235/464] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:50.977873 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.028305 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.065662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.079357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177657a8-5a87-4993-9b7b-d852844f0e40 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.100415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dafdda-7f33-44a3-9553-1645f16e7681 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.118937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.119547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.119829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.120104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.120830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:51.121145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.123165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.130211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 230/465] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/role_assignments?user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:51.130211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.147903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.149307 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.149797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.150375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.151519 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:51.152047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.153876 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.177762 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 236/466] 10.222.0.27 () {56 vars in 1137 bytes} [Wed Oct 12 14:26:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:51.183818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.255962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc1791-e814-41cc-950c-396499c34e11 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.287385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.311691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f67a14-21bc-4471-b6a5-997e052e356c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.317159 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.318389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.318875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.319358 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.320137 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:51.321014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.322898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.336235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 231/467] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:51.337021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.344037 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.359735 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.360039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.360471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.360744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.453523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.454990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5cc52-58d3-42c4-bdb3-63b1b843ea00 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.455111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.504501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.505363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.505638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.506425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.571999 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.573453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 237/468] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:51.575408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.601603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.604207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.607124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.702864 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef290-b200-42f2-a89a-5dec239e7cfe None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.716410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 232/469] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:51.717645 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.745036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.745673 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.745954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.746257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.754082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.755652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:51.768888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:51.769786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 14:26:51.770696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:51.774578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 238/470] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:51.775567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.807279 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.829401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686b009-b20b-4df4-9ba3-ec499c66f988 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.867234 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b504-805e-470f-b465-74700ad073fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.868268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b504-805e-470f-b465-74700ad073fc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.869010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b504-805e-470f-b465-74700ad073fc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.869674 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:51.870369 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b504-805e-470f-b465-74700ad073fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.882888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b504-805e-470f-b465-74700ad073fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.883857 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f8c2-42c1-48db-a546-3265c2847058 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:51.884844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b504-805e-470f-b465-74700ad073fc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d398b504-805e-470f-b465-74700ad073fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:51.901832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:51.903363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:51.904208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:51.904208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:51.904208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:51.906546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 233/471] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:51.907725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b504-805e-470f-b465-74700ad073fc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:51.925180 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:51.925818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:51.926103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:51.926767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:51.938113 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:51.939616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:51.955575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:51.956482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:51.957311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:51.957311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:51.957311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:51.961289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 239/472] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:51.962141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.025647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b504-805e-470f-b465-74700ad073fc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.057055 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.064856 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.065762 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.065967 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e88ba-a5a3-4c2d-bb84-dc8c079a5d74 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.066479 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.066978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.068005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.068543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.070192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.092311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 234/473] 10.222.0.27 () {56 vars in 1139 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.093612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.107956 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.108580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.108885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.109122 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.109769 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.110074 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.111578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.120563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.130555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 240/474] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.131445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.209091 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6257d8-18c3-4355-8ec2-0ef5fad00cc7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.232698 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d8510-9346-4e6f-a84a-92a36d9ec4af None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.247909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.248798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.249290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.249751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.250698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.251237 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.252852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.266408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 235/475] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.267541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.272823 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.273480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.273784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.274079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.328301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.352995 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.359165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.360644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.391004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c6a12-fb64-44e0-b519-7bd11b9aa44d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.429341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.430372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.430843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.431326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.438966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.440851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:52.453460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:52.454361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:52.455200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:52.457346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 236/476] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:52.458511 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.474278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 241/477] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:52.475274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.572199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf518b-ab0e-42ab-bf34-3cdd6e579784 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.577071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.580795 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd9d51-2ae1-4479-a775-2acb965c42ed None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.584962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.612911 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.613866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.614395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.614955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.620976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.621608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.621949 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.622271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.622994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.623289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.624484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.624779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.626510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:52.640872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:52.641778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:52.643078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:52.643484 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 242/478] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.643553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.645349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 237/479] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:52.654129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.752011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aeb96b-be9b-42bf-b83a-3be751e0e77d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.764272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542c810-0f78-4d7a-8270-cf4ff0a007cc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.792963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.794230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.794586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.794881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.805326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.805656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.805934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.806263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.806541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.807123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.807220 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.807523 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.808948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.821378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 238/480] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.822007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2bdbfe56-a3cf-4bf2-9b1c-b23a95748500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:52.826570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:52.827473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:52.828335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:52.828335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:52.828335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:52.828335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 243/481] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:52.829465 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065bdb4-0162-428a-99dc-2a4efdd935a9 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.829751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065bdb4-0162-428a-99dc-2a4efdd935a9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.830021 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065bdb4-0162-428a-99dc-2a4efdd935a9 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.834272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 244/482] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:52.834272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065bdb4-0162-428a-99dc-2a4efdd935a9 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:52.851091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.856852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:52.934062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd8b05-6e51-46d8-b2cb-b2247b29b1e0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.943283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065bdb4-0162-428a-99dc-2a4efdd935a9 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:52.970770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.971373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.971675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.972024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.972862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=9cd9f8c45f0743579418354966a74ff3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.973170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.974750 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.977414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:52.978040 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:52.978377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:52.978692 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:52.979411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=fd11abedcea148cd863b25261a0b37e3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:52.979718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:52.990246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 239/483] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/role_assignments?user.id=9cd9f8c45f0743579418354966a74ff3&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:52.990458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bdbfc-1e98-4b0e-a896-a957dc9518ec None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:52.990572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.002515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 245/484] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/role_assignments?user.id=fd11abedcea148cd863b25261a0b37e3&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:53.004009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.004373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.004749 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.029877 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:53.034206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:53.176839 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 246/485] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:53.195536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1be66-8bca-472f-a723-8a4721e0fd92 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.198685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.237917 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.238866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.239288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.239746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.240404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:53.240706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:53.242097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52fe1c-588f-4df8-b40a-8aa723919069 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:53.254939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 240/486] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:53.260351 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.270482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.372265 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d876ae-bac3-4e9f-88be-6c5bad95a629 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.397506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d825a2-8614-4081-b06f-389aabce6f22 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.397879 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d825a2-8614-4081-b06f-389aabce6f22 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.398249 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d825a2-8614-4081-b06f-389aabce6f22 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.399942 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 241/487] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:53.405114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.405505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.405943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.412012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.412838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.413278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.413696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.421558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:53.423206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:53.426961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:53.431317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:53.436275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:53.437270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:53.438293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:53.439365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 247/488] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:53.445190 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.521812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 242/489] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:53.526291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.538570 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.602561 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54c8c3-c688-450f-a1da-c7c0bfb4ceed None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.668797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.669421 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.669700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.669972 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.670699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:53.671002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:53.672546 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:53.686257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 248/490] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:53.691283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.692432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.716592 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b24de-7574-4311-bca7-49a5e577e1a3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.755093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.756002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.756288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.756562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.768756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:53.774144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:53.775065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:53.775862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 243/491] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:53.783013 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.892618 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3c100-6743-4204-b571-f9f94e142568 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.897825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95189d-61e7-4ec1-a152-081c4eabcc68 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:53.927476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.940373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.940895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.941176 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.941449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.942112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:53.942441 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:53.942884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:53.943732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:53.943900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:53.944359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:53.945456 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:53.946853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=1342faa2ddc741ad9f0f5122041b209b) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:53.947164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:53.948572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:53.957337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 244/493] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:53.958490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:53.962315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 249/493] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/role_assignments?user.id=1342faa2ddc741ad9f0f5122041b209b&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:53.963259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:53.963368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.108606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7da81-5c48-469d-9119-380f23b1cd9f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.160976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9c952-249c-44a0-bad6-c2c5fed6e861 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.194113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.196117 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.196875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.198672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.222623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:54.228920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:54.230601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:54.231643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 245/494] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:54.232873 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.233795 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.234352 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.234822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.237060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.251754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.255211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:54.277596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:54.279189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:54.280059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:54.280059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:54.280059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:54.282551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 250/495] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:54.287707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.328018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:54.358509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:54.383870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd099f7-1f63-4202-abad-d1bb772038f7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.422769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.423376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.423813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.424036 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.424703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:54.425026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.426562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:54.436136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 246/496] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:54.436689 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7fa5-da8b-4ced-9e6b-4c60f2204516 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.441582 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.479205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.480162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.480644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.481176 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.482096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:54.482651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.484242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:54.500647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 251/497] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:54.506822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.580811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1caa5-a430-4fd1-920e-cbdb4f2daa2d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.609767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:54.620907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.622420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.622923 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.623392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.639132 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.641138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:54.670900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:54.671900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:54.672872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:54.672872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:54.672872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:54.679791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 247/498] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:54.685993 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.738516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7f8a-1d6c-4a45-af10-f87570af035d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.749372 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:54.777208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.778490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.779259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.780019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.791968 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.794363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:54.807921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:54.808898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:26:54.810430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:54.813509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 252/499] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:54.822294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:54.889647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bd715-55e5-4ee3-a939-e1d29c5a0af2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:54.964680 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:54.970902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:54.971187 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:54.971464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:54.972123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:54.972426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:54.973809 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.002042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 248/500] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:55.006501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549273d5-5fb5-4c44-81a0-c21980c83fcc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.011148 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.042629 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.044044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.044474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.044893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.045763 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:55.046280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.047997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.066715 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 253/501] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:26:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:55.072483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.115132 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.122864 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.179179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66500b8-5bbe-4484-a04e-1560ddc86027 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.215762 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.216734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.217165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.217670 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.254306 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e90-2317-4425-82ca-afdbd14dc2be None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.306339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.309367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.328329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.329204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.334574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.335049 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.345104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.346681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.348145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:26:55.369536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:55.370852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:26:55.372341 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:55.378766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 249/502] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:55.383931 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.435397 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 254/503] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 14:26:55.441264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.547001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994c6f5-c90b-483b-a444-3120a0045428 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.570010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.571534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.579000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392ad48-fd36-4f26-8251-cb087ca1efd3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.588944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.589856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.591014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.591494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.604069 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.605683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.620559 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.621532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-43a7b1c2-5988-4683-a0fa-d2e540ca6220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:55.621939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:55.622867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:55.623737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:55.623737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:55.623737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:55.624255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.624691 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.625595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:55.626063 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.627773 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35375187-0b94-487d-9b4c-044313085b32 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.627935 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 255/504] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:26:55.629271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499656d9-4a0e-49fa-a8b8-92f3a9aeccb7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.629638 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499656d9-4a0e-49fa-a8b8-92f3a9aeccb7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.629986 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499656d9-4a0e-49fa-a8b8-92f3a9aeccb7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.631719 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 256/505] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:55.636034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499656d9-4a0e-49fa-a8b8-92f3a9aeccb7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.662927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 250/506] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:26:55.663896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.664186 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.664460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.687001 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:55.689117 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:55.766657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499656d9-4a0e-49fa-a8b8-92f3a9aeccb7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.782213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 251/507] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:55.782213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.809018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.809560 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.809844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.810119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.810789 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:55.811152 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.812791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ee2bd-6beb-4215-ade4-8a015529e3bd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.832016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 257/508] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:55.833404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8615b8-2b62-47f0-a136-83448412c7a8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.833696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8615b8-2b62-47f0-a136-83448412c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.833970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8615b8-2b62-47f0-a136-83448412c7a8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.839310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 258/509] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:55.839310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8615b8-2b62-47f0-a136-83448412c7a8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:55.875037 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.899639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:55.917072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec59a2-88f2-419d-8954-a75c9aafbd6a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.952959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:55.953541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.953950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.954310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.957071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8615b8-2b62-47f0-a136-83448412c7a8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:55.965706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:55.967291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-bae6c3ec-889a-4ad6-8697-2f7d7725c788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:55.982505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:55.983532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:55.984599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:55.984599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:55.984599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:55.984599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 252/510] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:55.985643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:55.985866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:55.986146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:55.998734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.000318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.000773 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.001244 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.005976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:56.007217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:56.009767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.012305 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:56.025591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:56.026511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:56.027934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:56.034248 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 259/511] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:56.035078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.098734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 253/512] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:56.098734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.141676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.151832 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e404df6-77e3-4aa6-8a2e-848e46c83917 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.167205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.190859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.191819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.192277 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.192691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.193473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.193921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.195700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.204329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5c025-bbcf-4ae6-b9b2-3c2c353bfd2f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.208653 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 260/513] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.209622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.246806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.247389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.247802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.248177 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.248974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.249382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.251014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.264789 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 254/514] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.265829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.317008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21668cb0-624c-4556-8125-2ca0f9c34fde None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.353762 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.354514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.354884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.355267 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.356478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.357923 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:56.368928 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:56.370202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:26:56.371399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:56.377865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 261/515] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:56.377865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.396204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.416223 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dccc81-e73e-4858-bf5d-287f8d8be44c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.444397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.454121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.454792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.455119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.455397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.462216 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.463669 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:26:56.475906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:56.476774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:56.477647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 255/516] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:56.478785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.490326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e9afe-b051-4b8a-9b81-271e181c58e3 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.533282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.534311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.534596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.534868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.535924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=4beca14124924c829fd429cef16bd5d8) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.536237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.537663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.554203 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 262/517] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/role_assignments?user.id=4beca14124924c829fd429cef16bd5d8&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.554203 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.627766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4caebfe-f837-4cec-9dfe-1ea1c3a0b27a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.660535 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.666689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.667327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.667609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.668081 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.668734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.669043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.670487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.679860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 256/518] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.679860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.688492 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4fbe4-60d2-4cc7-967e-798bec37e4df None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.725877 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.726796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.726796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.727066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.738809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.740256 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.742005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0e44ae9a-3c5b-40df-9528-a692a8fc321a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:26:56.757908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:56.758914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:26:56.759821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:26:56.759821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:26:56.759821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:56.759821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 263/519] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:56.760462 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f0c5-86d7-4091-a22b-c600d9d49bf1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.760462 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f0c5-86d7-4091-a22b-c600d9d49bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.760725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10f0c5-86d7-4091-a22b-c600d9d49bf1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.762165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 264/520] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:56.762908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10f0c5-86d7-4091-a22b-c600d9d49bf1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.797379 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09aead-7ab1-44cb-93e4-41959a4cbaa0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.834217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.834886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.835168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.835441 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.836184 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.836509 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.837952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.850641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 257/521] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.851452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:56.883603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10f0c5-86d7-4091-a22b-c600d9d49bf1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.914874 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:56.921285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:56.921903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.922204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.922489 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.923113 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:56.923416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:56.924783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a751766-7634-4cfd-9623-4a8cbb27b6a1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:56.938216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 265/522] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:56.938216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:56.938216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:56.938216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:56.956442 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:56.957753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:56.965563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bc99-c96d-4bdf-8b51-24084eac84d1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:56.980094 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:57.016076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:57.016735 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:57.017258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:57.017541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:57.019231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:57.019549 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:57.020977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:57.036547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 258/523] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:57.037896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:57.061293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 266/524] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:57.067196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:57.193461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0599-5cc8-45a3-aaa9-1d09d0ca26de None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:57.242800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3fdd1-5479-4a15-b2ea-018d94dd29a3 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:57.281165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:57.282189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:57.282625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:57.283488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:57.284393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:57.290374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:57.291108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:57.309427 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:57.314368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:57.315061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:57.315345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:57.320975 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=4ae307c1cb064d0cb4b8b61cc5fe13d3, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:57.322480 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:57.322765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 267/525] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:26:57 2022] POST /identity/v3/users => generated 254 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:26:57.345781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 259/526] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:26:57 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:26:57.457476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:57.581516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0026f-0039-485b-be77-849b81468083 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:57.617773 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:57.618447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:57.618728 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:57.618997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] PATH_INFO: `/v3/services/network` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:57.619628 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:57.621529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:57.630801 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:57.631781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:26:57.632616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 268/527] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:26:57 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:57.637725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:57.676904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:57.751608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42508632-f03f-42f3-8e6d-e3be71314b95 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:57.802916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:57.803538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:57.803819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:57.804177 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:57.804817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] RBAC: Adding query filter params (name=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:57.805119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:57.806539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b5d53-48d0-411b-b05c-66c6cab6bddd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:57.813808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 260/528] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:26:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:57.819413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:57.882489 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:57.958569 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068049-7fe9-42bb-b353-5394973fb82a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:58.010988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:58.012509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:58.013025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:58.013501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:58.014625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] RBAC: Adding query filter params (type=network) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:58.015133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:58.016732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28727b5-a94b-4cd8-adbf-223456658c4d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:26:58.025912 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 269/529] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:26:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:26:59.029499 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07fbe-6868-4318-8df9-e69e07c19efb None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.029997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07fbe-6868-4318-8df9-e69e07c19efb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.030073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07fbe-6868-4318-8df9-e69e07c19efb None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.031669 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 261/530] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:59.036982 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d4d6-69a8-49c4-8a52-26b18bbb1f88 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.037365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d4d6-69a8-49c4-8a52-26b18bbb1f88 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.037586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2d4d6-69a8-49c4-8a52-26b18bbb1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.055956 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-47d2d4d6-69a8-49c4-8a52-26b18bbb1f88 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:59.057114 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-47d2d4d6-69a8-49c4-8a52-26b18bbb1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:59.149872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 270/531] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:26:59.437785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07fbe-6868-4318-8df9-e69e07c19efb None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:59.467871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9da66-f05a-4b5d-93e8-fe0bcd2c5562 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.468202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9da66-f05a-4b5d-93e8-fe0bcd2c5562 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.468416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9da66-f05a-4b5d-93e8-fe0bcd2c5562 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.469858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 271/532] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:26:59.475836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.476116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.476384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.512751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:26:59.514296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:26:59.583274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:59.606076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:26:59.617312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07fbe-6868-4318-8df9-e69e07c19efb None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:59.646531 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 272/533] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 14:26:59.680428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:59.681112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.681446 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.681723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.702069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:26:59.707100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:26:59.708009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:26:59.708859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 262/534] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:26:59.716309 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:26:59.905943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e96af-83fc-4624-9793-d174541ff0fe None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:26:59.976350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:26:59.976888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:26:59.977166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:26:59.977430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:26:59.978108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:26:59.978422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:26:59.979860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e170e4-1e6e-4e24-b4b2-6655e620158e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:00.002047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 273/535] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:00.007872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.038206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b620e-e123-4199-874a-3f24e2b7344d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.038206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b620e-e123-4199-874a-3f24e2b7344d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.038206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b620e-e123-4199-874a-3f24e2b7344d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.038206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 274/536] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:00.042540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b620e-e123-4199-874a-3f24e2b7344d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.078121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:00.163383 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b620e-e123-4199-874a-3f24e2b7344d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:00.205012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:00.205634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.205918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.206225 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.209483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:00.211270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90140f52-4392-4ec3-9071-db2fa1983abf None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:00.228620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72825d1f-1a56-4710-adf8-af4633c59375 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:00.234390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 275/537] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:00 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:00.235706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.235995 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.236269 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.257505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:00.258797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:00.296139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:00.297934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.298247 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.298527 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.317847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:00.319444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:00.338705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:00.339943 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:00.341267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:00.341267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:00.341267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:00.341267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 263/538] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:00.349016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.360532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:00.422479 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 276/539] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:27:00.505663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce5f67-621d-48bb-9c1a-6f92a8ff88a0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:00.541406 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:00.542429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.542884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.543353 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.544221 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:00.544702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:00.546254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7cd756-1b0d-4366-820e-c753615f4457 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:00.560011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 264/540] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:00.565288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.600087 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:00.608707 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0341-3f9e-48a3-975f-aad04b042bc9 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.609957 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0341-3f9e-48a3-975f-aad04b042bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.610376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f0341-3f9e-48a3-975f-aad04b042bc9 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.612137 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 265/541] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:00.617268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.617553 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.617825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.638059 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:00.639590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:00.708883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:00.721360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 266/542] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:27:00.743011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.753962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4ca3e-c080-4e3c-bd01-8b1f489d73b0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:00.851095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:00.851682 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.851965 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.852239 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.866347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e343-ddce-46a6-8953-e009e62081f9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:00.871483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:00.872969 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:00.899656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:00.900635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:00.902054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 277/543] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:00.909651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:00.910331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:00.910612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:00.910884 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:00.918117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:00.923489 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:00.928658 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:00.930870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:00.932921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 267/544] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:00.937961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.017492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.058842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.066746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fca457-dff7-4f3b-ad20-c66c218981a4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.077826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4ce02-ffd7-440b-b052-eefcb8ca9b97 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.104685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.105217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.105501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.105773 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.106471 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:01.106779 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.108170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b20c0-faf0-460b-8014-43e7f0cac8d5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.114196 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.114806 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.115427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.115427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.116065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:01.116368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.117780 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.118778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 268/545] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:01.124785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fbbd-ff3d-4b09-be8b-cbf67f5092ca None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.125080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fbbd-ff3d-4b09-be8b-cbf67f5092ca None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.125356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133fbbd-ff3d-4b09-be8b-cbf67f5092ca None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.126735 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 269/546] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:01.130474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133fbbd-ff3d-4b09-be8b-cbf67f5092ca None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.141499 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 278/547] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:27:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:01.142687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.235581 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133fbbd-ff3d-4b09-be8b-cbf67f5092ca None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.252694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.257558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53659d-cb88-4ccf-beb3-1144ada58b74 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.272330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.272932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.273210 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.273479 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.284970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a8e944bf-1a95-4b34-ad61-90e6e8cb2ca3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:01.289785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:01.290751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:01.291577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 270/548] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:01.293009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.293009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.293009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.301272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.301912 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.302284 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.302485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.311611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.311845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:01.313208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:01.314142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.316820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:01.332209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:01.333375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:01.334295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:01.334295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.334295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:01.334295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 279/549] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:01.334295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.399690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 271/550] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 14:27:01.400986 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.446883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf07b5-b9f4-4c9c-b944-11152de49ee5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.487809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.488474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.488757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.489023 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.499863 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.501345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:01.517041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:01.518227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:01.519304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:01.519304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.519304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:01.519304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 280/551] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:01.523047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.551662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea1ca-7a74-407d-b353-2b195fb2fb0b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.563048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.576210 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.605435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.606377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.606864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.607359 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.608755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:01.609283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.611361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.627253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 272/552] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:01.627253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.645694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761389ab-a678-4e74-ac7d-25b75705658d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.688940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.689444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.689722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.690014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.690648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:01.690945 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.692745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.709846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 281/553] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:01.709846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.748470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4e5d1-9b24-4591-bd8c-20c2f3d706ce None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.781880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.782546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.782831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.783108 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.783749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:01.784115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.785504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.797651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 273/554] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:01.798451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.820786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a58c3-707c-4ec2-bade-68c1a2281175 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.824373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.828408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:01.862505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.863177 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.863455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.863772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.875035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.876638 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:01.892503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:01.893482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:01.899149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:01.899149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:01.899149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:01.899149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 282/555] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:01.899149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:01.906790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd606-5909-480c-be8a-02dc0018c0ef None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:01.946026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:01.946586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:01.946868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:01.947136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:01.947772 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:01.949164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:01.970238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 274/556] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:01 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:01.970238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.025493 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f98e3-f448-4178-b1da-5e3a2ba950fc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.084222 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.087401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.088053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.088343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.089922 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.100739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.103242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.104744 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546debf3-1f82-4223-9cf4-286c3fe0a936 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:02.116495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:02.117694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:02.118784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:02.121606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 283/557] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:02.123300 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.141656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.156092 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.156731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.157583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.157583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.165952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.167522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:02.181110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:02.182034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:02.183510 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:02.184236 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 275/558] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:02.184753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.256923 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a645a3c-a576-4674-aad8-8c4480d8c237 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.297702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06941c0c-9bb7-4118-a209-0a2dca7652b8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.301115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.301902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.302345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.302769 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.303571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:02.304012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.306123 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.319719 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 284/559] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:02.320870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.340331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.341088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.341470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.341846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.342718 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:02.343123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.344664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.366223 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 276/560] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:02.366223 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.377602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.406303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.442768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dc793-0d64-42fb-a456-ce2454616d4c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.481417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6cf02-2535-41d1-8df4-16d0df6a00c8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.490988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.491856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.492771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.493319 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.494743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:02.495506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.497868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.515485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 285/561] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:02.516651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.524136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.524779 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.525055 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.525327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.533230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.534741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:02.547455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:02.548414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:02.549346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 277/562] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:02.549934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.626008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.657342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0779-7bdb-4cd8-812b-d5d68839874e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.669875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c87bc-6da9-4517-acdf-8dfa1244944a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.692908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.701046 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.701877 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.702151 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.702453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.710574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.711567 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.712051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.712535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4beca14124924c829fd429cef16bd5d8/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.714057 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.715490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=4beca14124924c829fd429cef16bd5d8, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.715600 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.717205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec8782-9b0e-4d86-b2b3-6aaee37b3e8a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:02.730018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:02.730997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:02.731898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:02.731898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:02.731898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:02.731898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 286/563] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:02.733538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 278/564] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:02 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4beca14124924c829fd429cef16bd5d8/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:27:02.734374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.735511 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb37da-2f0b-4108-be65-30699d99671b None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.736031 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb37da-2f0b-4108-be65-30699d99671b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.736555 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb37da-2f0b-4108-be65-30699d99671b None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.739519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 279/565] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:02.740610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb37da-2f0b-4108-be65-30699d99671b None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.870476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0106b3-043a-4145-8d6c-b3da13884f8d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.877208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb37da-2f0b-4108-be65-30699d99671b None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:02.908486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:02.910615 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.911454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.912070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.912464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.913361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:02.913693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.915360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2299f8-310c-430b-a29c-ee25fece04b8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.920418 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:02.921030 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.921308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.921578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.922254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:02.922557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:02.923915 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:02.935555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 287/566] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:02.936934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:02.937447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:02.937572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 280/567] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:02.937770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:02.941098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:02.958638 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:02.959692 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:02.996832 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.030431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 288/568] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:03.031426 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.072203 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721683-7760-4fd2-8797-8ca1c97298e4 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.111146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.112010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.112447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.112816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.134229 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb8ec1-1f65-4852-a07c-ec6216609c80 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.169831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.170506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.170783 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.171053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.175527 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.177891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.179360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.190573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:03.191103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:03.192830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:03.194747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:03.195632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.202238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 289/569] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:03.202238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.229936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.301987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d1bd-3f10-46a1-aac2-9259a1a6fbbc None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.308278 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 281/570] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:03.317253 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.337002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.337681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.337882 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.338204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.338939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:03.339330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.340652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.357054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 290/571] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:03.358338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.422656 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.443821 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9113c58-5b68-4905-bb6d-05b3366cef93 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.455408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.462166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649ef6d-6916-4abe-8e6d-646bbd358b64 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.498315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.498315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.498315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.498638 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/819d82f467814fe79b103bf663e86ed7/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.514708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=819d82f467814fe79b103bf663e86ed7, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.515619 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.516323 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.516729 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.517199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.517660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.538510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 291/572] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:03 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/819d82f467814fe79b103bf663e86ed7/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:27:03.540146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.542509 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:03.571106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:03.572202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:03.573128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:03.573128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:03.573128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:03.582199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 282/573] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:03.582391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.602317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.772549 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c6881-cdcb-4086-81cd-e77d7436e100 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.787576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7b59d-4732-493f-be9e-117fe6387998 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:03.811171 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.812128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.812612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.813109 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.813888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.815490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.827997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:03.828610 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:03.828887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:03.829159 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:03.829804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:03.830103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:03.831340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:03.832270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:03.833105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:03.833824 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:03.835985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 283/574] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:03.844879 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.845192 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 292/575] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:03.850470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:03.850654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.858096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:03.983070 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6e0c-8270-4ec2-8e4f-4542a400cc54 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.015604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942085-3ade-472c-b12e-8f334d309121 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.054260 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.055398 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.056384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.057295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.062098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.063521 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.064217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.064991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.066753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:04.067740 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.070360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.077070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.080009 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.083841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 284/576] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:04.089336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:04.107794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:04.108722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:04.109737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 293/577] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:04.123075 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:04.178483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:04.237338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643912d-6ef3-4cf6-95a9-7d313f95fda7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.256975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:04.304949 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573b7e0-eef9-4641-8599-7de0e93e23f1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.307974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.308595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.309140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.309140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.309739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:04.310036 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.311440 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.327547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 285/578] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:27:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:04.332098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:04.378622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.379264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.379553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.379822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.380503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:04.380800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.382250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.407156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 294/579] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:04.414868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:04.489377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e3de-85da-4b92-a04f-d141d268b6ac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.527641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:04.535197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.536068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.536348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.536621 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.537311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] RBAC: Adding query filter params (interface=public, service_id=e78d8c5baed24d1c8774d486fbbae35f, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:04.537616 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.538665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e407a-d6f9-4f7e-b0cc-8b86082209e1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.539014 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b849f-b688-4d9e-a97f-042c52d4c1d8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.548978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 286/580] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:04 2022] GET /identity/v3/endpoints?service_id=e78d8c5baed24d1c8774d486fbbae35f&interface=public®ion_id=RegionOne => generated 194 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:04.550748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91ef7-e2b3-438b-af66-756af4da67c5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.551032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91ef7-e2b3-438b-af66-756af4da67c5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.551308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b91ef7-e2b3-438b-af66-756af4da67c5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.557835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 287/581] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:04.557835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b91ef7-e2b3-438b-af66-756af4da67c5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:04.570433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:04.585950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.587478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.587754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.588077 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.588796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:04.589101 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.591445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f0e32-1b31-45d2-9248-48929e61474c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.604929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 295/582] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:04 2022] GET /identity/v3/role_assignments?user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:04.604929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.604929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.604929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.642943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:04.644166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:04.771132 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b91ef7-e2b3-438b-af66-756af4da67c5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:04.793643 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 296/583] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:04.834453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:04.835401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:04.835883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:04.836357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:04.837161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:04.839382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:04.845520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 288/584] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:04 2022] GET /identity/v3/services => generated 772 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:05.079712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:05.184099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5e94c-0961-409c-a3ff-e6f6acd3f58b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:05.201270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:05.220040 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:05.220729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.221011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.221279 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.221863 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:05.223273 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-5e1fe917-aabd-4799-92aa-0e4c397497e5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:05.232607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:05.233722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:05.235303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 297/585] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/services/network => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:05.240104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:05.305626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:05.369561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b95a1c-5816-49b6-8a27-e33a9681e4c8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:05.391626 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734ae0-bfa5-41d7-aa6a-8243cd2e51d2 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.392124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734ae0-bfa5-41d7-aa6a-8243cd2e51d2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.392201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0734ae0-bfa5-41d7-aa6a-8243cd2e51d2 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.393723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 298/586] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:27:05.400237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.400237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.400237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.432797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:05.434807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:05.450769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:05.451393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.451679 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.451952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.452588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] RBAC: Adding query filter params (name=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:05.452887 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:05.454377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:05.463444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 289/587] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:05.472312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:05.564679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 299/588] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:05.633561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd1542-20da-4992-a737-8e16e564f9ab None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:05.667576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:05.682867 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:05.683531 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.683817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.684088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.684727 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] RBAC: Adding query filter params (type=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:05.685088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:05.686437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:05.693391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 290/589] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:05.699347 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:05.844765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d613b-da72-48d0-9e5e-725eaf551810 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:05.860997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:05.895964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:05.896932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:05.897501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:05.897983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:05.898914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] RBAC: Adding query filter params (interface=public, service_id=bd6194f902eb4d3c838ac9346a3146ee, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:05.899435 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:05.901518 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:05.912547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 300/590] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/endpoints?service_id=bd6194f902eb4d3c838ac9346a3146ee&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:05.917929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:05.928505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.112511 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bcfd6-bfc6-47f8-8258-fe3df6dc20cc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:06.114404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7085811-766c-4093-bb41-2e5b2a2a669b None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:06.158150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:06.159169 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.159667 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.160132 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.174596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:06.175667 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.176890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.179186 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.180002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:06.181666 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4ee86-fde3-4034-a447-af8a9bc1287b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:06.183621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:06.189108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:06.190014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:06.190893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:06.195840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 301/591] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:06.197772 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 291/592] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:05 2022] GET /identity/v3/services => generated 772 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:06.202782 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.246743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:06.260098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc42edc-3640-4666-96a7-da64b103c32c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.260423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc42edc-3640-4666-96a7-da64b103c32c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.260652 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc42edc-3640-4666-96a7-da64b103c32c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.262495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 292/593] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:06.273717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.274049 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.274313 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.306712 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:06.307950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:06.378357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:06.396952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e8c61-a34f-49fe-9d1a-019c2158045c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:06.427699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 293/594] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:06.451922 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:06.452545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.452829 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.453105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.453770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:06.454076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:06.455479 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:06.470651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 302/595] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:06.476121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.591169 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ace1-482f-4c5c-a357-9f6fe61925fe None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:06.633575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:06.634682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.635186 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.635670 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.651061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:06.652791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:06.673037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:06.674011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:06.674955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:06.674955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:06.674955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:06.677053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 294/596] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:06.682980 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.759894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.820331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:06.841131 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:06.849878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22949ba-362e-4192-bb19-03bab6a42828 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:06.920509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:06.921130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:06.921407 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:06.921677 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:06.922361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:06.922667 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:06.924050 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:06.945503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 303/597] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:06.952185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:06.957495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ddc4-376c-412e-9ec6-b790ec408f55 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.060642 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafca5e-d125-421d-819b-4ae6dccc7316 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.074899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.075551 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.075823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.076100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.095161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.095942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.096227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.096500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.101996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:07.104500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.105947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:07.107655 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:07.108588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:07.109431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 295/598] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:07.114648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:07.126534 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:07.128760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:07.131115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 304/599] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:07.137018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.170428 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.293950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.316111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7f7d7-bb42-41d9-aced-44f4b2dcfaf3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.346853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de787db8-8805-490e-aec8-4dacb888948a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.368739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.369754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.370280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.370808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.371676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:07.372201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.374020 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df92aeb-c672-4bb3-9e56-e0baff1b1200 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.381454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.382054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.382400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.382639 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.383386 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:07.383686 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.385227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.385729 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 296/600] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:07.388016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117658a-f679-4a66-976f-4efb38e3a880 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.388534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117658a-f679-4a66-976f-4efb38e3a880 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.389100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117658a-f679-4a66-976f-4efb38e3a880 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.395250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 297/601] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:07.397114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.397650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.398130 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.421606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 305/602] 10.222.0.27 () {56 vars in 1135 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:07.421606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.426401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:07.427603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:07.495104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.502509 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 298/603] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:07.502509 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.528663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529f122-f8c3-4504-93ce-f444b335f820 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.569128 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.569846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.570331 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.570676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.583633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.585710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-cfc08d76-e2c4-4613-af3b-f3183bf4a290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:07.603704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:07.604751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:07.605718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:07.605718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:07.605718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:07.609497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 306/604] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:07.610753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1420-e778-4beb-988f-ed6a36b6974e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.611036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1420-e778-4beb-988f-ed6a36b6974e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.611312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e1420-e778-4beb-988f-ed6a36b6974e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.612051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.617786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 307/605] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:07.617786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1420-e778-4beb-988f-ed6a36b6974e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.632591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbfa3a-1f3b-4187-b8cf-b11bb713213a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.683675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.684743 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.685499 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.686435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.735822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e1420-e778-4beb-988f-ed6a36b6974e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:07.763632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.773765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:07.774430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.774769 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.775047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.775737 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:07.776052 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.777413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89856be0-95f9-44de-8bea-8f3c4bc9037b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.779592 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:07.781721 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:07.789414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 308/606] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:07.791212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:07.791494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:07.791766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:07.809715 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:07.810926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:07.880221 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:07.883860 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 309/607] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:07.884936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:07.914244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 299/608] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:07.915476 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.001313 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b55ee-d366-4a1a-ac05-d7294f569951 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.019141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.035869 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b7905d-250d-44c2-8af8-c0452d544e1e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.039285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.040230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.040726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.041230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.042023 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.043709 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:08.052891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:08.053991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:08.054942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:08.061405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 310/609] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:08.061405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.083731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.084705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.085757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.086368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.097646 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.100541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:08.120136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:08.121121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:08.122123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:08.128082 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 300/610] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:27:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:08.128082 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.178257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.195816 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9b896-6a54-4f23-abfb-b0426eb7d25f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.231258 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.231922 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.232205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.232483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.237385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ec40f-b47c-4010-8abe-ceabb8744cac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.243774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.245223 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:08.260487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:08.261450 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:08.263206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:08.263206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:08.263206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:08.263206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 311/611] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:08.263206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.279688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.280426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.280799 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.281174 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.281802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:08.282104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.283492 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.288529 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 301/612] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:08.289220 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.301136 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.381391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5c09f-60d3-4922-80e6-df3e3012b039 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.392507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2ef4b-f618-471f-a042-46833c1da1ef None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.402258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.421713 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.423148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.423910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.424750 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.425954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:08.426460 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.428058 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.429410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.429985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.430291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.430564 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.431186 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.432541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:08.441461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:08.442450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:08.448417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 302/613] 10.222.0.27 () {56 vars in 1129 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:08.449348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.451607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 312/614] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:08.452600 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.546114 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.556440 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3c40d-4a92-48ce-bcad-f8ed09a732fe None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.556721 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b1155-4765-4528-9e5b-89aab1c1dda9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.597798 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.598007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.598434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.598562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.598734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.598835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.599016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.599119 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.599616 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:08.599735 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:08.599912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.600006 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.601282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.601382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.606519 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 313/615] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:08.607374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.626551 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 303/616] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:08.628103 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.665414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.727807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d263703-d377-4b5c-bdaf-4610e89775d8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.745565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb991b9-fb27-4bdd-9c8e-0c810f2c3bab None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.765424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.766037 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.766363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.766902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.767258 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:08.767554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.768941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.774080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 314/617] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:08.775488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.789115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.789740 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.790089 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.791039 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.797743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.866569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.868576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.889976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8965-0460-47b5-b35c-ca99947a68c4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:08.902301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:08.926294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:08.926931 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.927215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.927490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.936255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:08.938441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-adb094bd-7693-4a80-8cdf-71242ee5a38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:08.951108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:08.952079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:08.953004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 315/618] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:08.953978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999d877-d8b5-468b-af51-3b2275847ee0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:08.954313 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999d877-d8b5-468b-af51-3b2275847ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:08.954584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999d877-d8b5-468b-af51-3b2275847ee0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:08.958220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 316/619] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:08.958220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999d877-d8b5-468b-af51-3b2275847ee0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:08.987219 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 304/620] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:08.992742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.048711 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.073748 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999d877-d8b5-468b-af51-3b2275847ee0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.100641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354be247-013a-4c1a-85f7-c6e4990c5d08 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.111517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.112148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.112425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.112692 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.113315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:09.113608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.114984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41acd2-86b1-4e60-828c-bc2fee427cb9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.120633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 317/621] 10.222.0.27 () {56 vars in 1124 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:09.121906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.122208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.122484 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.137719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.141419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:09.142699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:09.143722 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.144343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.144670 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.144895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.145590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:09.145893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.147364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.159086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 305/622] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:09.159890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.221909 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 318/623] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:09.222772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.297703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319c50-9e38-4b49-91b0-2c52c580d498 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.299844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.332684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43131e-ae06-4da9-ae7a-1555741f60ab None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.347725 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.349073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.349759 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.350200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.365883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.367562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.370049 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.370784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.371214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.371707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.372393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.373856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:09.386099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:09.387552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:09.388819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:09.388819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:09.388819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:09.390565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 306/624] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:09.391496 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.414672 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 319/625] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:09.415891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.443595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.508741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e074d9-6b36-4975-ad4c-869d7e656717 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.554972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.555903 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.556228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.556495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.557758 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=4beca14124924c829fd429cef16bd5d8) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:09.557946 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.559719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.567366 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 307/626] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/role_assignments?user.id=4beca14124924c829fd429cef16bd5d8&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:09.568409 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.612307 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641021c-f2c7-42da-b8f9-dddd7e5a6d1f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.658293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.670624 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.671306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.671608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.672330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.672647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:09.672952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.674373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.690579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 320/627] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:09.700409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.757301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63dc92-1f32-43a1-b3c3-551b0688eb8c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.761170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:09.807845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.808632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.808910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.810451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] PATH_INFO: `/v3/services/network` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.811237 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.812798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:09.823183 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:09.824340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 14:27:09.825451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:09.827532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 308/628] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:09.832950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975a9-9ffb-441f-8a43-eb796cb097d7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:09.837648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:09.891394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:09.892030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:09.892307 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:09.892576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:09.907765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:09.909206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:09.928943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:09.929910 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:09.930919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:09.936474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 321/629] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:09.937550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:10.038349 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:10.048213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6cfcf-a61d-45e8-b413-d9e3481f1c23 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:10.119126 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7b320-2a21-47c7-9e80-dd0ffdd88a13 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:10.120971 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:10.121587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.121899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.122190 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.122831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] RBAC: Adding query filter params (name=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:10.123132 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:10.124521 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:10.145424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 309/630] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:10.152622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:10.174836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:10.175833 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.176283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.176752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.177665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:10.178154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:10.182163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:10.201226 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 322/631] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:10.206696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:10.218151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:10.330114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072aa7ca-1250-42b1-b7c6-acd71f061786 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:10.350198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109b85-a383-4f4f-bc74-3a7e7e630fc2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:10.359968 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:10.389633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:10.390164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.390461 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.391455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=819d82f467814fe79b103bf663e86ed7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:10.391756 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:10.393169 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:10.406900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 323/632] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:10 2022] GET /identity/v3/role_assignments?user.id=819d82f467814fe79b103bf663e86ed7&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:10.418474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:10.419102 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.419377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.419648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.420281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] RBAC: Adding query filter params (type=network) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:10.420577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:10.421946 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed942b5-3ee4-422e-bea3-9a6c483ae4fe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:10.431114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 310/633] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:10.437020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:10.561539 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b85bfa-6be4-4d60-bc41-0eb5f5319bb7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:10.602662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:10.603291 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.603567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.603837 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.604515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:10.605903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3cb56-cdc9-45b0-addf-767d0afeb33f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:10.632540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 324/634] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:10.943119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09813-17ec-4770-ab11-74f8a77dbfee None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.943630 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09813-17ec-4770-ab11-74f8a77dbfee None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.943630 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09813-17ec-4770-ab11-74f8a77dbfee None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.944968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 311/635] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:10.952032 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a783-e84f-4112-96c8-195ac59a51b7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:10.952384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a783-e84f-4112-96c8-195ac59a51b7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:10.952632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a783-e84f-4112-96c8-195ac59a51b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:10.976554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-85b7a783-e84f-4112-96c8-195ac59a51b7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:10.977852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-85b7a783-e84f-4112-96c8-195ac59a51b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:11.007941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:11.061974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 325/636] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:11.330342 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e09813-17ec-4770-ab11-74f8a77dbfee None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:11.432428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:11.440426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e09813-17ec-4770-ab11-74f8a77dbfee None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:11.477416 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:11.478126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:11.478431 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:11.478699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:11.479352 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:11.480710 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca5cfd-e937-4923-a844-5ec8a419808f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:11.499623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 312/637] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:11 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:11.957973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c57-b55c-4816-90fa-b7e96bd27752 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:11.958511 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c57-b55c-4816-90fa-b7e96bd27752 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:11.958589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c57-b55c-4816-90fa-b7e96bd27752 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:11.960153 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 326/638] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:11.965844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:11.966264 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:11.966432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:11.984675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f35b-d37f-4fde-bb65-53f8c71ec1ee None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:11.984996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f35b-d37f-4fde-bb65-53f8c71ec1ee None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:11.985220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636f35b-d37f-4fde-bb65-53f8c71ec1ee None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:11.987506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:11.988702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:11.988996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 327/639] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:11.997104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:11.997391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:11.997659 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.017729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:12.019214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:12.078223 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 313/640] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:11 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:12.100275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 328/641] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:11 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:12.343862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.373113 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.439333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:12.463168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542678-381f-4ed4-9642-414d57a2f76e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.464042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:12.480276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e238-bd60-4fb5-89ee-399f4809ddb7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.509298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.510542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.511959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.512693 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.513468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.515069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.516376 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.517008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.517287 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.517562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.518149 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.519517 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:12.526910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:12.527902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:12.528817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 314/642] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:12.535370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:12.540270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:12.541338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:12.542198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 329/643] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:12.547025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.671071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b4338-f827-4e16-91ac-77bbef63a510 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.674899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21330ded-8c40-4d8f-bb78-b2b8ae86872d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.708992 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.709647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.709887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.710135 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.710787 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:12.711623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.712988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.722562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 330/644] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:12.722889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.723487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.724051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.724534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.725030 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.725886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:12.726769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.729329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.736387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 315/645] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:12.739728 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:12.742663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:12.762062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:12.847296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd4ced-5df3-4443-8316-8169cc802df9 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.854778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782002-7d5b-4483-9a9e-e7f936127962 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:12.889333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.890369 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:12.890760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.890992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:12.891267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.891653 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.891920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:12.892306 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:12.892611 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.892718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:12.893567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:12.894025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0a46-5002-4885-800c-148de0fa3bbf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.894368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:12.896103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af773f1a-cae9-4498-ab96-ad821049dc90 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:12.900106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 316/646] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:12.902924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 331/647] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:13.024630 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0add-e41b-4e17-b61a-3205b58e52e7 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.025164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0add-e41b-4e17-b61a-3205b58e52e7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.025164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f0add-e41b-4e17-b61a-3205b58e52e7 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.026892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 317/648] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:13.032821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.033374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.033374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.053985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:13.055360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:13.133919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 332/649] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:13.402535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f0add-e41b-4e17-b61a-3205b58e52e7 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:13.483574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:13.515167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f0add-e41b-4e17-b61a-3205b58e52e7 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:13.550974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:13.551612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.551892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.552165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.564121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:13.569453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:13.571005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:13.571843 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 318/650] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:27:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:13.579554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:13.591105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:13.692055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0b4af-60be-43d8-b257-7f545ce96311 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:13.727403 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:13.728011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.728285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.728553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.729211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:13.729507 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:13.730887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d427-d3fd-4b6c-a218-325f8ab9c91e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:13.739494 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 333/651] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 12 14:27:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:13.744824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:13.782608 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6940-99fb-470d-a686-8bdcf856f00e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.782907 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6940-99fb-470d-a686-8bdcf856f00e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.783146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6940-99fb-470d-a686-8bdcf856f00e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.784477 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 334/652] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:27:13.789949 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.790246 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.790514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.811855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:13.813761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:13.859846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aae25d-c1dd-4384-b82c-94bf48f5a143 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:13.896817 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:13.900301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:13.900935 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:13.901240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:13.901497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:13.903535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:13.910463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 335/653] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:13 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:13.916816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:13.918307 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:13.933812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:13.934968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:13.936120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:13.936120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:13.936120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:13.936120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 319/654] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:13.940786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.048248 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfc3f5-b23a-42ba-9750-3ee216f78f11 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.083582 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.084471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.084892 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.085366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.086691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.087133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.088621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.100501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 336/655] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:14.107787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.208725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.216009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcded3b-d2c7-4cda-a637-013fe316d365 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.253717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.255024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.255024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.255024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.263770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.265099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:14.276830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:14.277977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:14.279107 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 320/656] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:14.284584 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.288502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:14.340014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e3677-d271-4555-835e-9bfbda0f7af1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.341822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:14.376984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.377716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.378072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.378448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.379111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.380535 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:14.390552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:14.391487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:14.397565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 337/657] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:14.399557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.415708 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b597b-3a24-4df6-b239-3f101745c4bf None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.452429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.453023 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.453304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.453580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.454331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.454651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.456282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.474506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 321/658] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:14.487250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.509422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b24c3-e062-46fb-b812-7bf245c97365 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.533579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:14.550042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.551130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.551640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.552131 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.552952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.553452 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.555111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.562186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 338/659] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:14.568656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.617826 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f0c51-ac5f-4d74-9f54-03b07c5a0c4e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.626524 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:14.658134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.658788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.659061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.659326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.670647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.672099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.680076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac43f8-b871-4373-9131-3ede1844e481 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:14.688444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:14.689504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:14.690458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:14.690458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:14.690458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:14.690458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 322/660] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:14.696663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.717554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.718861 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.719369 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.719869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.720749 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.721256 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.722893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.729429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 339/661] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:14.735315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.795046 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:14.826976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76225df9-c9a3-475b-9c3e-5eb4b36661f1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.852378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a766cb-fcd2-4f54-98f1-28f7f72f4d25 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:14.875146 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.876554 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.877297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.877764 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.878889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.879808 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.881976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.890495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:14.891185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:14.891582 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:14.892169 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:14.892656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] RBAC: Adding query filter params (interface=public, service_id=523e673e94674e1e9d7d8ef5dc95025e, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:14.893029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:14.894881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:14.903318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 323/663] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:14.904462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.905343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 340/663] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/endpoints?service_id=523e673e94674e1e9d7d8ef5dc95025e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:14.906607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:14.924626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.019759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06c07e-d561-47f9-bdd2-682054e07ff2 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.035554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.038792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44dbc0-2b41-4355-95b4-a6360ce26c4d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.058166 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.058793 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.059179 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.059525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.060208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.061664 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.074318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 341/664] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/services => generated 1029 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 14:27:15.080577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.081546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.082012 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.082534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.091909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.093796 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-8bf4568a-e5be-46cf-902b-700b683b6daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:15.107088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:15.108546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:15.109434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:15.111790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 324/665] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:15.117825 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:15.121576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a85cc-66da-4e62-8809-ef157f3f415f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.122114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a85cc-66da-4e62-8809-ef157f3f415f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.122568 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a85cc-66da-4e62-8809-ef157f3f415f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.124316 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 325/666] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:15.130539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a2b3-35b0-4e46-ade9-dad23731970d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.131078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a2b3-35b0-4e46-ade9-dad23731970d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.131534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a2b3-35b0-4e46-ade9-dad23731970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.155387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3690a2b3-35b0-4e46-ade9-dad23731970d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:15.157254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3690a2b3-35b0-4e46-ade9-dad23731970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:15.246941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e2bd5-39b4-486d-a065-3da65c529ad8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.259340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 326/667] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:15.273385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915ca7-9745-4c4c-b848-8fde065b6dfb None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.273796 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915ca7-9745-4c4c-b848-8fde065b6dfb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.274148 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28915ca7-9745-4c4c-b848-8fde065b6dfb None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.275865 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 327/668] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:27:15.281205 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.281562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.281902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.284008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.284697 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.284981 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.285259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.285994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:15.286344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.287777 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.295623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.303658 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 342/669] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:15.305505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:15.306792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:15.309914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:15.354415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.401074 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 328/670] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:15 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:15.425363 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56239de8-6277-4099-b6d9-fa9765878102 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.461685 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.462507 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.462796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.463072 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/819d82f467814fe79b103bf663e86ed7/roles/40be9e4af9564816886ec5e90519b330` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.465364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=819d82f467814fe79b103bf663e86ed7, role_id=40be9e4af9564816886ec5e90519b330)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.467093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.484240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 343/671] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:15 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/819d82f467814fe79b103bf663e86ed7/roles/40be9e4af9564816886ec5e90519b330 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:27:15.548676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:15.666331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afe7e1-165e-411c-9b8e-6efb6af0a840 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.682289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:15.709687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.710857 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.711142 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.711415 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.712072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.713447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfda4-0ad6-4bb2-acc9-da399b540bb2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.717807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.742343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 329/672] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:15 2022] POST /identity/v3/services => generated 241 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:15.816714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:15.822746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ce9be-a13f-434f-a3e2-b0536445c743 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:15.868658 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:15.869621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:15.870042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:15.870508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:15.871413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:15.872940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2a4e-4bae-455c-9b36-172e770a8119 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:15.891328 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 344/673] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:15 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:27:17.338213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de22-c900-4c5d-b3e6-b80a85ad7d0f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:17.338726 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de22-c900-4c5d-b3e6-b80a85ad7d0f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:17.338726 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de22-c900-4c5d-b3e6-b80a85ad7d0f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:17.340255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 330/674] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:17.345522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfab7-11cb-4ee8-9eb2-da0c1c4942eb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:17.345980 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfab7-11cb-4ee8-9eb2-da0c1c4942eb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:17.346070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfab7-11cb-4ee8-9eb2-da0c1c4942eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:17.365947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cd3bfab7-11cb-4ee8-9eb2-da0c1c4942eb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:17.367548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cd3bfab7-11cb-4ee8-9eb2-da0c1c4942eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:17.446526 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 345/675] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:17.700030 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d4f-24f8-43bb-84d2-2405718a8797 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:17.700373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d4f-24f8-43bb-84d2-2405718a8797 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:17.700566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5d4f-24f8-43bb-84d2-2405718a8797 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:17.702245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 331/676] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:17.707571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:17.707874 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:17.708148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:17.712770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5d4f-24f8-43bb-84d2-2405718a8797 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:17.730410 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:17.731594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:17.827494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5d4f-24f8-43bb-84d2-2405718a8797 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:17.834236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 346/677] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:17.868641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:17.869678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:17.870207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:17.870753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:17.871586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:17.873246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-688a8c79-e4ef-4ed3-814b-e778f1cd9ce1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:17.883831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:17.885192 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 14:27:17.886100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:17.889118 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 332/678] 10.222.0.27 () {56 vars in 1132 bytes} [Wed Oct 12 14:27:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:17.895541 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:17.910558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.002225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047fb0-e9c0-4d20-bd20-f41806fbb58e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.002225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047fb0-e9c0-4d20-bd20-f41806fbb58e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.002225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f047fb0-e9c0-4d20-bd20-f41806fbb58e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.002225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 333/679] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:27:18.003193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffb2a1-bc20-49e5-9fca-9ec957c8634f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.008154 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.008465 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.008741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.027774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:18.029120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:18.039129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.039743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.040025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.040298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.040932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:18.041236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.042687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.052676 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 347/680] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:18.053947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.098570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.118360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 334/681] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:18.133927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.154992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.159564 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a15a0-80c7-4305-8c11-fe47e6593b6e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.197957 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.198932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.199411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.199906 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.200722 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:18.201243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.202831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623289a8-4fd3-4f06-b7ce-4794a4deacb6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.207862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 348/682] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:18.209171 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62dfa-8339-4906-a0c0-a01650254ade None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.209453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62dfa-8339-4906-a0c0-a01650254ade None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.210312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e62dfa-8339-4906-a0c0-a01650254ade None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.211678 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 349/683] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:18.214905 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62dfa-8339-4906-a0c0-a01650254ade None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.269213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e9e4-4560-44f9-825a-940e4bad76ec None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.304333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.305092 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.305377 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.305641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.316336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2c758ca3-b991-465d-b17e-ecb097b332b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:18.321597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:18.322546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:18.323392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:18.325508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e62dfa-8339-4906-a0c0-a01650254ade None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.327532 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 335/684] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:18.329050 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.329334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.329605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.347154 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:18.348326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:18.360808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.361409 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.361688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.361954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.362623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.364219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.373562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.394919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 350/685] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:27:18.394919 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.409100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.446429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 336/686] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:18.446429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.517076 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0184ad-2f12-4790-b6de-e5d9c9ba2ff7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.558492 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.559352 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.559635 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.559902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.560866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:18.561094 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.563970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.578207 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 351/687] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:18.580367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.591688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1eb48-a598-4413-9cab-c9d16ca298dc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.637554 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.638832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.639286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.640029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.641058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.642792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:18.655127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:18.656115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:18.656927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:18.658718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.659596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 337/688] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:18.662549 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.724856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fbe37-8316-4d12-97ec-6fc00eacfd45 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.725620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.763934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.765046 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.765335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.765662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.778723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.780171 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.790817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c20d-8694-4155-8f44-28f35ccb6060 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:18.796669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:18.797633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:18.798592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:18.798592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:18.798592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:18.798592 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 352/689] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:18.799334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.829379 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.829997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.830163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.830512 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.831123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:18.831424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.832775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.837977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 338/690] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:18.839113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.913209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc339c3-6369-45f2-b2f1-cad1191d5435 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.923788 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.944749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540310b8-57fc-4b3d-8f93-de3772096aa1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:18.947075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:18.954380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.955456 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.955800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.956139 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.957041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.958586 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:18.968495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:18.969726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:18.970808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:18.974579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 353/691] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:18.975493 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:18.990523 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:18.993417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:18.993417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:18.993417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:18.993417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:18.993417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:18.994013 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.006085 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 339/692] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.007314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.091211 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e77cc-0cdb-4c1d-9b7a-8af2ee54cb92 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.109285 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03386e-05e2-47e8-8d72-e06a48eb2857 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.127466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.128073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.128347 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.128614 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.129233 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.129530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.130923 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.140881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 354/693] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.140881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.149771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.150494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.150844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.151122 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.151747 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.152051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.153417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.158734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 340/694] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.159794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.184101 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.191356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.255217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c87d07-cbb7-4ce8-aaeb-39a432669868 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.269910 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572fe2c-f6ff-4500-b99e-2164ad46b6c9 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.291389 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.292014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.292286 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.292554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.300523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.301947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.307466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.308257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.308675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.309139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.309981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] RBAC: Adding query filter params (interface=public, service_id=dc29dfca74ab48edbfe815736b61b5f5, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.310491 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.312131 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:19.313894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:19.315044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 355/695] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:19.315978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.325930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 341/696] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/endpoints?service_id=dc29dfca74ab48edbfe815736b61b5f5&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.327196 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.421650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.422472 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.431300 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8c38-4682-4745-9e0c-af4ae2590d51 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.432767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21912d0-af3d-47f8-abaf-0977563435aa None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.465562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.466296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.466572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.466852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.467448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.467745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.467972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.468577 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.468853 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.469099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.469194 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.469829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.470140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.471563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.479756 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 356/697] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.479756 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.494227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 342/698] 10.222.0.27 () {56 vars in 1149 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.499134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.581609 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377f79-247c-42f4-a89d-d5d7cff38247 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.608442 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2e20d-2951-42a4-9b9c-b7e8d518af96 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.617458 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.618054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.618357 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.618626 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.619212 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.620556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.634214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 357/699] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:27:19.634214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.656314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.657041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.657385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.657738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.658689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] RBAC: Adding query filter params (interface=public, service_id=bb9cdd14588649099857f3a252247f17, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:19.659072 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.660565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.663669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.669368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 343/700] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/endpoints?service_id=bb9cdd14588649099857f3a252247f17&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:19.675214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:19.695058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:19.771982 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e027-3eb2-4df6-9c18-50a97264d447 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.801776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8322cc5-b21b-4e89-918e-0d9a177c80cf None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:19.821108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.822241 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.822662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.823487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.842047 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:19.842829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:19.843203 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:19.843578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:19.844189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.845560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.853410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 344/701] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:27:19.903130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:19.904681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:19.932826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:20.029858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 358/702] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:20.035913 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:20.120699 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:20.144548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f483993-cc03-40b1-b022-f9a2a690b8db None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:20.181304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:20.181953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.182259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.182534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.193081 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:20.194594 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:20.210633 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:20.211640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:20.212692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:20.212692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:20.212692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:20.212692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 345/703] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:20.217588 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:20.317647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346734d3-646f-4ca7-99ba-a9c658da07a4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:20.341199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:20.352354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:20.352973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.353247 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.353516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.354246 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:20.354551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:20.356040 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:20.368528 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 359/704] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:20.374207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:20.481518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11279829-ba1f-4e90-9ae8-bf556c648e44 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:20.512780 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:20.519495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:20.520163 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.520439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.520706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.528784 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:20.530311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a69652a3-a3b6-4718-8221-50da9f9f9690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:20.543690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:20.544660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:20.545548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 346/705] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:20.552530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:20.637057 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd571-7402-42b7-a5c2-5c815c59dfdb None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.637412 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd571-7402-42b7-a5c2-5c815c59dfdb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.637605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cd571-7402-42b7-a5c2-5c815c59dfdb None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.639249 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 347/706] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:20.644425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.644702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.644968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.665426 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06dd9f-3c48-4569-8252-7234e2e78eea None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:20.665900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:20.667280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:20.701104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:20.701717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.701996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.702298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.702987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:20.703289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:20.704777 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:20.717851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 360/707] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:20.723890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:20.750339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 348/708] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:20.777224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:20.830439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e80835-4a8f-410f-8d6d-6a552e2ae57f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:20.865027 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809984-9176-425d-8a07-95588605c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:20.866199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809984-9176-425d-8a07-95588605c708 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:20.866488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809984-9176-425d-8a07-95588605c708 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:20.866761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04809984-9176-425d-8a07-95588605c708 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:20.867496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809984-9176-425d-8a07-95588605c708 None admin] RBAC: Adding query filter params (role.id=40be9e4af9564816886ec5e90519b330, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=819d82f467814fe79b103bf663e86ed7) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:20.867804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809984-9176-425d-8a07-95588605c708 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:20.869262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04809984-9176-425d-8a07-95588605c708 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:20.876557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 361/709] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:20 2022] GET /identity/v3/role_assignments?user.id=819d82f467814fe79b103bf663e86ed7&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=40be9e4af9564816886ec5e90519b330 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:21.045793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:21.147026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123b38f-50f9-45c0-bcb1-2057c17d1d31 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:21.167899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:21.182471 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:21.183111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:21.183384 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:21.183651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:21.184229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:21.185604 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:21.195032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:21.197245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:21.199266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:21.201024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 349/710] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:21.206217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809984-9176-425d-8a07-95588605c708 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:21.304249 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04809984-9176-425d-8a07-95588605c708 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:21.313285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:21.339083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:21.339689 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:21.339965 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:21.340230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:21.340844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:21.341140 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:21.342528 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7515c-4f3a-4672-a7a2-ea532ae6d959 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:21.352002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 362/711] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:21.353336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:21.458291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb5d0-7656-4d20-973a-d359986c56dc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:21.493597 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:21.494363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:21.494545 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:21.494791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:21.495423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:21.495723 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:21.497101 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93962599-be8a-43c9-98c0-c0e306643971 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:21.502371 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 350/712] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:21.940392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300314-2211-47e7-a419-53aabb3d13f2 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:21.941098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300314-2211-47e7-a419-53aabb3d13f2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:21.941098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9300314-2211-47e7-a419-53aabb3d13f2 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:21.942542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 363/713] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:21.948315 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe535a-642c-4720-a875-29726c05de16 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:21.948601 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe535a-642c-4720-a875-29726c05de16 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:21.948877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe535a-642c-4720-a875-29726c05de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:21.967334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-03fe535a-642c-4720-a875-29726c05de16 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:21.968590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-03fe535a-642c-4720-a875-29726c05de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:22.024590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:22.049627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 351/714] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:22.198260 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a8a8-1598-4b1d-92a3-8acf36967b68 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.198575 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a8a8-1598-4b1d-92a3-8acf36967b68 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.198741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a8a8-1598-4b1d-92a3-8acf36967b68 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.200346 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 364/715] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:22.205536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.205815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.206084 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.225753 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:22.227330 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:22.299304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 352/716] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:22.317618 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a8a8-1598-4b1d-92a3-8acf36967b68 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.428236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a8a8-1598-4b1d-92a3-8acf36967b68 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:22.461985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:22.462580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.462991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.463260 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.463833 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:22.465243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:22.474001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:22.475073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.475918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 365/717] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:22.483462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.583678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b675c-43cf-4c68-b744-cca826ad428c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:22.584577 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.596220 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:22.623953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:22.624958 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.625497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.625778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.626443 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:22.626739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:22.629026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:22.635391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 353/718] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:22.638638 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:22.641960 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.703177 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5ef66-ff9c-4f75-bd52-873585a7ef35 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:22.739214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:22.740038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.740213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.740470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.741053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:22.742444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:22.752240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:22.753289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:22.754668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 366/719] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:22.760077 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.770474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd473-b49b-442b-addc-d67363887810 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:22.815575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:22.816681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.817451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.818738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.819718 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:22.820504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:22.822595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:22.829816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 354/720] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:22.842201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.861348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:22.865694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52303f1a-480a-4345-ae98-757c920f09e6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:22.887204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:22.902804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:22.903663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:22.904101 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:22.904379 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:22.905007 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:22.905427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:22.906908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:22.912187 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 367/721] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:22.917571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:22.967712 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487e9f-b384-4b65-931e-1b16ee3bcb37 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:23.018378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:23.019185 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.019566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.019949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.021769 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:23.023547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:23.033837 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2432f-070c-4dd5-8814-b7390ce449c0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:23.054469 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 355/722] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:23.089865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:23.090901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.091367 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.091914 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.092770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:23.093267 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:23.094982 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda31ef1-d631-4f45-ad84-1bdd37991183 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:23.101991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 368/723] 10.222.0.27 () {56 vars in 1114 bytes} [Wed Oct 12 14:27:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:23.108888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:23.197233 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077514a-7958-40a1-9875-50afd8eec12f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.197521 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077514a-7958-40a1-9875-50afd8eec12f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.197799 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077514a-7958-40a1-9875-50afd8eec12f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.199488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 369/724] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:23.205302 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.205589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.205862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.220283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:23.228529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:23.230059 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:23.230421 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34dd3b1-92ac-44f0-9f77-d512a6d3a513 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:23.251158 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:23.272121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:23.272706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.272982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.273250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.274874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:23.276256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:23.302831 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 356/725] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:23.319807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 370/726] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:23.586456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:23.700840 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fa3cd-18da-45b6-bb67-04da21b63196 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:23.737709 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:23.738649 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.739078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.740051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.740779 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:23.742339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-babb5801-365a-4940-8b11-3004560a95f3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:23.751825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:23.753025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:23.754065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:23.756551 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 357/727] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 12 14:27:23 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:23.762667 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:23.777150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3633-cea5-4a48-9821-bfdcbf7d2b4a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.777433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3633-cea5-4a48-9821-bfdcbf7d2b4a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.777705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e3633-cea5-4a48-9821-bfdcbf7d2b4a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.779514 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 358/728] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:23.784282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.784567 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.784842 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.811947 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:23.813396 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:23.824506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:23.878159 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f636a-c577-42da-9b77-5a3a717483bb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:23.910068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 359/729] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:23.928293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:23.929110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:23.929391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:23.929664 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:23.930376 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] RBAC: Adding query filter params (name=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:23.930682 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:23.932100 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:23.937372 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 371/730] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:23.943112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:24.057921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbe879-7d1a-4d0b-a506-94d55774c60f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:24.097994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:24.098645 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:24.099448 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:24.099720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:24.100339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] RBAC: Adding query filter params (type=image) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:24.100635 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:24.102007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02c9ea-9e15-4568-950f-58dd3601635b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:24.106935 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 360/731] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:24.230133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:24.250022 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:24.341407 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a997-c527-43a3-ae50-881dd58e9d6a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:24.376999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:24.378025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:24.378595 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:24.379064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:24.379970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:24.381536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4642f-3040-4a0c-940f-e95d31632555 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:24.401427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 372/732] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:24 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:25.308958 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c063-11b5-4375-a068-5264c573cd20 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:25.309447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c063-11b5-4375-a068-5264c573cd20 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:25.309447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c063-11b5-4375-a068-5264c573cd20 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:25.310906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 361/733] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:25.315964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa76cb-e209-43c5-8ba6-3efb67492aeb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:25.316365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa76cb-e209-43c5-8ba6-3efb67492aeb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:25.316550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa76cb-e209-43c5-8ba6-3efb67492aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:25.335753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-73fa76cb-e209-43c5-8ba6-3efb67492aeb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:25.336938 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-73fa76cb-e209-43c5-8ba6-3efb67492aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:25.414680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:25.423356 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 373/734] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:25.524832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a06e-7689-4777-9fbb-7f49e2e2cc24 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:25.525151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a06e-7689-4777-9fbb-7f49e2e2cc24 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:25.525379 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36a06e-7689-4777-9fbb-7f49e2e2cc24 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:25.526979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 362/735] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:25.532093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:25.532385 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:25.532660 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:25.551130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:25.552368 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:25.623581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 374/736] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:25.691008 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a06e-7689-4777-9fbb-7f49e2e2cc24 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:25.701178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:25.800976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36a06e-7689-4777-9fbb-7f49e2e2cc24 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:25.836398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:25.837120 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:25.837449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:25.837726 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:25.838336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:25.839706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:25.848873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:25.849864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:25.850745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 363/737] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:25.856317 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:25.911134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:25.965787 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ee7ee-8985-43a4-a450-85600c4f3824 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.001123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.008240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.015748 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.016390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.016671 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.016943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.017564 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:26.017869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.019544 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.031013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 375/738] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:26.033389 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.047297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c109b33-5f05-4751-99bf-6b0b7dca4989 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.084200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.084810 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.085090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.085365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.086011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.087486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.090118 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING keystone.server.flask.common [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 14:27:26.108558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.sql.core [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:26.108558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:27:26.108558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [parameters: {'id': '5abd5ab30be2429f89942c8ae8da30ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 14:27:26.108558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5abd5ab30be2429f89942c8ae8da30ff.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5abd5ab30be2429f89942c8ae8da30ff. Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:26.131572 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 14:27:26.132533 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application yield resource Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise self.value Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application session.commit() Oct 12 14:27:26.133754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.flush() Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application compat.raise_( Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 14:27:26.134694 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 14:27:26.136455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:26.138382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [parameters: {'id': '5abd5ab30be2429f89942c8ae8da30ff', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:26.140539 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:26.142583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5abd5ab30be2429f89942c8ae8da30ff. Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 364/739] 10.222.0.27 () {60 vars in 1140 bytes} [Wed Oct 12 14:27:25 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:26.145046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.169173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7390ee7-4567-4ae1-8390-b07a6000145d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.212799 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.214041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.214610 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.215155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.216080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:26.216603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.218451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.229671 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 376/740] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:26.230509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.273328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0dbff-69a2-41ba-9358-a0c8380447cc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.302088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.303617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.314636 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.317476 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.317988 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.318468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.327105 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.329095 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:26.341876 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:26.342941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:26.343838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:26.346417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 365/741] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:26.349555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57727bfa-6cb2-4e7f-be26-2d1e76cb049f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.358228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.391127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.391994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.392272 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.392542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.393247 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] RBAC: Adding query filter params (interface=admin, service_id=dc29dfca74ab48edbfe815736b61b5f5, region_id=RegionOne) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:26.393550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.395051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35a2e9-d544-4f96-8be3-88e7b187bf27 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.400679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 377/742] 10.222.0.27 () {56 vars in 1249 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/endpoints?service_id=dc29dfca74ab48edbfe815736b61b5f5&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:26.404183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773876-7893-4f26-9b83-04769bcf9245 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.404982 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773876-7893-4f26-9b83-04769bcf9245 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.405464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee773876-7893-4f26-9b83-04769bcf9245 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.407130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 378/743] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:26.411206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773876-7893-4f26-9b83-04769bcf9245 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.463134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf6cc0-fbba-4652-8c8d-ce69a657b166 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.503414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.504026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.504301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.505106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.505766 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:26.506066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.507583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb67de0-ad2c-4692-81d5-daf0ee9f59be None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.522080 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee773876-7893-4f26-9b83-04769bcf9245 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:26.536756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 366/744] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:26.536756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.536756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.536756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.549648 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.550958 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:26.552705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:26.563942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:26.564921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.565530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.565530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.566241 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:26.568217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dc3a-a37e-4891-b7b4-216b50a40b84 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:26.575645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 379/745] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:27:26.576936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3c6c-ae77-4e2b-885d-8c914d06af87 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.577218 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3c6c-ae77-4e2b-885d-8c914d06af87 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.577489 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea3c6c-ae77-4e2b-885d-8c914d06af87 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.579002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 380/746] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:26.584778 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:26.585062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:26.585324 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:26.605223 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:26.606573 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:26.609346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:26.642344 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 367/747] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:26.696524 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 381/748] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:26.924741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:26.965891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:27.067562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ac047-2a38-41a4-b9f1-6b5f9e7f0dab None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.084189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340b6c-1407-44fd-8334-7d5908fad890 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.106300 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.106524 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:27.106981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.107265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.107542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.108204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.109741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.127243 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 368/749] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:26 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:27.135641 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.136304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.136579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.136846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] PATH_INFO: `/v3/services/compute` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.137496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.138947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:27.149083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:27.150129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:27.151445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 382/750] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:27.156707 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:27.197812 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:27.274616 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43065c5-2dd0-42d4-8fbf-5c03dfd519c8 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.315552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.316199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.316429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.317218 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.317858 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:27.318262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.319675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.326479 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 369/751] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:27.332030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:27.437980 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a245c-a5dc-4612-937c-252df01e53be None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.473740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.474401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.474684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.474958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.475584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:27.475887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.477249 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.482475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 383/752] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:27.488312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:27.598690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:27.602287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd43014-182e-412b-9604-dfd8d052c819 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.637913 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.638811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.639310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.639755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.640683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] RBAC: Adding query filter params (interface=public, service_id=fbcadc84483142a4aa65164c9d8a864b, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:27.641168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.642791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dfee6-aa21-4fa5-933e-825b4333ff76 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.649001 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 370/753] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:27 2022] GET /identity/v3/endpoints?service_id=fbcadc84483142a4aa65164c9d8a864b&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:27.654417 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:27.697280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:27.757244 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573230be-c6f2-4ba9-b281-886e363cb3a5 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:27.791883 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:27.792551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:27.792833 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:27.793104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:27.793703 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:27.795087 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abdc6-6fae-437d-a1d6-eddf138def77 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:27.801983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 384/754] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:27 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:27:28.817430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e23d-f25d-490b-8a7d-37a240592956 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:28.818029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e23d-f25d-490b-8a7d-37a240592956 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:28.818029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7e23d-f25d-490b-8a7d-37a240592956 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:28.819594 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 371/755] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:28.824979 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:28.825374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:28.825540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:28.827614 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d4b5-01be-441b-8106-711a84e35af4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:28.827901 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d4b5-01be-441b-8106-711a84e35af4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:28.828349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620d4b5-01be-441b-8106-711a84e35af4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:28.829841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 372/756] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:28.835060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:28.835340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:28.835613 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:28.846215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:28.846800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:28.860328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:28.862404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:28.926292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 385/757] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:28 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:28.936038 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 373/758] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:28 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:29.188116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.202254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.224096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.313346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.327683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae829-5e91-4eff-ae1a-87ae2f725c28 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.370028 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.370985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.371522 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.372062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.372811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.374511 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:29.384844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:29.385836 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 14:27:29.386717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:29.393835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 374/759] 10.222.0.27 () {56 vars in 1126 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:29.395065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.414102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1df69-08ff-4f9a-88b5-8b0b6124de47 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.449066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.449879 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.450156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.450451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.451086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.452939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.456495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING keystone.server.flask.common [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 14:27:29.473099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.sql.core [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 14:27:29.473099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 14:27:29.473099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [parameters: {'user_id': 'f675ddc705e240d19e4603f1d44331fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 14:27:29.473099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81561) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-aba89f31-e09a-483d-8d7c-93ec2e0dcbc3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:29.480091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:29.481013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application yield resource Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise self.value Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application session.commit() Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 14:27:29.482053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.session.flush() Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application compat.raise_( Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 14:27:29.483566 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:29.484445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:29.485289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f675ddc705e240d19e4603f1d44331fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:29.487365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 12 14:27:29.489885 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 386/760] 10.222.0.27 () {60 vars in 1131 bytes} [Wed Oct 12 14:27:29 2022] POST /identity/v3/users => generated 160 bytes in 294 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82b51-ed21-402b-aeda-2be0fdf6fe5d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82b51-ed21-402b-aeda-2be0fdf6fe5d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.493109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82b51-ed21-402b-aeda-2be0fdf6fe5d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.494424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 387/761] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:29.494424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd82b51-ed21-402b-aeda-2be0fdf6fe5d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.509349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a03616-a717-4d13-8c38-5541efaee24a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.548734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.549365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.549642 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.549924 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.552145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:29.552145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.552397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78ef47-b68a-4572-9c10-b765e4b25254 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.558147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 375/762] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:29.559466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.559806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.560108 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.579238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:29.580400 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:29.596573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.607454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.616557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd82b51-ed21-402b-aeda-2be0fdf6fe5d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.653766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.654422 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.654698 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.654959 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.662864 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.664505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.664921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 376/763] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:29 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:29.666388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:29.677322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:29.678320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 14:27:29.679274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:29.683299 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 388/764] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:29.684510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.797145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712848b-7bd0-49ab-b2e7-309c736dd53f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.803008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256b0c8-2d86-42ab-85c6-ea6e88819615 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:29.833362 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.834041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.834265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.834534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.835224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:29.835453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.836895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.847254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 377/765] 10.222.0.27 () {56 vars in 1122 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:29.848161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.848970 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:29.850103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:29.850893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:29.851360 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:29.853191 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:29.853695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:29.855344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:29.867426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.906975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 389/766] 10.222.0.27 () {56 vars in 1101 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:29.922985 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:29.944829 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:29.970055 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915809d-9b88-4679-b1af-4943157ab616 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.022915 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.023542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.023815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.024080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.024759 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.026166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0d615-36e8-41ec-a4bc-5551f92aa380 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.051688 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 378/767] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:29 2022] POST /identity/v3/endpoints => generated 325 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:30.060162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a99f4-a46e-4f62-9945-888cad45280c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.060551 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a99f4-a46e-4f62-9945-888cad45280c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.060918 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a99f4-a46e-4f62-9945-888cad45280c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.062833 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 379/768] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:30.069113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.069396 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.069676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.089416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e4eb-47be-4d55-9aa3-19a9ca34a7c8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.091244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:30.092762 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:30.146199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.146199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.146199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.146199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] PATH_INFO: `/v3/services/image` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.146693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.146693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:30.158270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:30.159408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.160855 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 390/769] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 12 14:27:29 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:30.166401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.179623 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 380/770] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:30.260031 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.288895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f5c5f-17dc-476d-b033-2a090eabce50 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.324653 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.325190 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.325473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.325746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.326425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] RBAC: Adding query filter params (name=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:30.326730 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.328160 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.333510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 391/771] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:30.339093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.347604 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.442564 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167f90-685c-4b29-aee8-639a3d41e63d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.453896 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.478338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.478947 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.479227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.479503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.480127 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] RBAC: Adding query filter params (type=image) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:30.480425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.481823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.487363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 381/772] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:30.493283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.567037 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1b65-f043-4102-a917-be91448c3a00 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.573516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.603224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.603771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.604050 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.604322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.604899 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.606283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.607612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2be12-5ba1-4998-b14f-9a40648a1491 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:30.615572 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:30.616568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:30.617427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 392/773] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:30.623091 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.626384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.651620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.652333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.652619 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.652893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.653602 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] RBAC: Adding query filter params (interface=public, service_id=8d32c4849db143b4a7a56d11e5b68811, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:30.653900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.655311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.660898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 382/774] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/endpoints?service_id=8d32c4849db143b4a7a56d11e5b68811&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:30.666628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.742872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e962a8-32f1-4cee-bd6d-47bee03f3251 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.772181 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b93b1-71fd-47a3-82c9-2318b73a9681 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.779873 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.780660 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.781086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.781503 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.782305 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:30.782772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.784277 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.790259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 393/775] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:30.795577 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:30.807711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.808327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.808606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.808877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.809478 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.810875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.812411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.830555 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 383/776] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:27:30.868894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:30.908148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9ae5e-8dc8-4ec4-b1a4-16255cb6ec58 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:30.945537 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:30.946201 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:30.946474 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:30.946743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:30.947387 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:30.947692 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:30.949084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b933c-6789-4763-bb30-09cc60cfe468 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:30.954947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 394/777] 10.222.0.27 () {56 vars in 1112 bytes} [Wed Oct 12 14:27:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:30.961156 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:31.076368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefd072-148a-4cfb-838c-680368835c0a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:31.114111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:31.114745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:31.115026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:31.115298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:31.115961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:31.117331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788c8e4-a52d-4e21-8a07-7a9026e7eede None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:31.139138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 384/778] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:32.307453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ffa5-544a-4bb4-9e8e-1675a517ab30 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.307945 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ffa5-544a-4bb4-9e8e-1675a517ab30 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.307945 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525ffa5-544a-4bb4-9e8e-1675a517ab30 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:32.309300 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 395/779] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:32.314501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.314892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.315053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:32.333466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:32.334679 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:32.384792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:32.411765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 385/780] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:32.678898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ffa5-544a-4bb4-9e8e-1675a517ab30 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:32.781078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525ffa5-544a-4bb4-9e8e-1675a517ab30 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:32.809448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:32.816349 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:32.816983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.817259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.817525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:32.818651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:32.820071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd757af-4487-433f-9bd2-e1d05107b481 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:32.821843 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 396/781] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:32.827376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:32.935984 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6dfeb-a948-4864-8938-a9066dffbf8d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:32.972535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:32.973147 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.973426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.973756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:32.974441 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:32.975900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:32.978109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d6836-49ee-41ce-898c-5674b61b2af7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.978416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d6836-49ee-41ce-898c-5674b61b2af7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.978673 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d6836-49ee-41ce-898c-5674b61b2af7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:32.983605 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 397/782] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:32.985844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24511-9ebe-4852-8600-9950d5d98908 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:32.985844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24511-9ebe-4852-8600-9950d5d98908 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:32.985844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24511-9ebe-4852-8600-9950d5d98908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.008498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-96f24511-9ebe-4852-8600-9950d5d98908 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:33.010001 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-96f24511-9ebe-4852-8600-9950d5d98908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:33.014511 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 386/783] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:32 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:33.085921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 398/784] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:33.355070 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.356026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e0ce-1b0f-4674-be03-333e3e023ac0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.356394 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e0ce-1b0f-4674-be03-333e3e023ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.356588 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518e0ce-1b0f-4674-be03-333e3e023ac0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.358063 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 399/785] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:33.363305 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.363584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.363853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.383993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:33.385176 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:33.390002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:33.459721 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afbee-04d1-4341-b7be-4a232213bfa7 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:33.462319 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 400/786] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:33.493292 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:33.493917 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.494208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.494476 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] PATH_INFO: `/v3/services/image` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.495048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:33.496395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:33.505361 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:33.506626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 14:27:33.507464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:33.508979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 387/787] 10.222.0.27 () {56 vars in 1105 bytes} [Wed Oct 12 14:27:33 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:33.512683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.575236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:33.617547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87232cd-bcb5-4ec4-b64e-b12dd5ca3980 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:33.652191 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:33.652793 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.653067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.653333 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.653944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] RBAC: Adding query filter params (name=image) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:33.654264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:33.655610 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:33.660603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 401/788] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:33.665992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.727156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.765015 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:33.774608 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9fa49-e13c-4deb-a90f-3dbc2b97a8af None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:33.810344 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:33.810949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.811228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.811553 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.812185 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] RBAC: Adding query filter params (type=image) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:33.812494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:33.813859 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:33.819355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 388/789] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:33.824860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.833253 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237fce9-04f8-4d26-9ce1-649b3a87407d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:33.857357 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:33.870803 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:33.871373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.871661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.871936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.884162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:33.889580 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:33.890545 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:33.891374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 402/790] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:27:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:33.897277 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:33.929643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6e4a-da48-46ea-8c11-83f0a68c5654 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:33.967754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:33.968474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:33.968765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:33.969036 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:33.969707 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:33.971154 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.010199 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 389/791] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:27:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:27:34.018475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344d6d3-f5f0-4f82-8e6d-696e2a879bd1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.062420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.063061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.063343 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.063614 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.064295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:34.064607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.066555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.076330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 403/792] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 12 14:27:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:34.082566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:34.102838 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:34.195671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae7936-d237-4cb6-96a4-7909fd709d04 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.230011 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.230673 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.230951 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.231217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.242392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.243834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:34.258334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:34.259286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:34.260179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:34.260179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:34.260179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:34.260179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 390/793] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:34.265740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:34.310645 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:34.369589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e535b14-582b-4f2f-914c-b095ef493f0a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.403467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.404073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.404350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.404617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.405243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:34.405540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.406916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.418890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 404/794] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:34.424294 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:34.491530 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:34.527863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1499f2-329c-40ca-9a7e-89d919d20324 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.560963 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.561624 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.561903 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.562232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.570233 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.571750 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:34.583373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:34.584282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:34.585229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:34.589180 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 391/795] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:34.590199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:34.685295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:34.689287 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f9ffa-4446-4939-8c2e-3211f69e234e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.723688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.724303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.724579 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.724851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.725574 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:34.725878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.727326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.745841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 405/796] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:34.751286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:34.852790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62c9f-d9ec-4c55-a283-95512d8eacfc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:34.879307 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:34.888412 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:34.889059 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:34.889337 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:34.889609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:34.902208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:34.903755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:34.918928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:34.919898 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:34.920787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:34.920787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:34.920787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:34.920787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 392/797] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:34.927454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.035654 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238747b-b775-453b-ae6d-6bea41885554 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.069994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886539cb-2682-488a-9379-00e62360555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.070616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886539cb-2682-488a-9379-00e62360555e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.070889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886539cb-2682-488a-9379-00e62360555e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.071153 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886539cb-2682-488a-9379-00e62360555e None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.071774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886539cb-2682-488a-9379-00e62360555e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:35.072068 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886539cb-2682-488a-9379-00e62360555e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.073403 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886539cb-2682-488a-9379-00e62360555e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.084778 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 406/798] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:35.090235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.196028 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb019de6-ac60-47c5-abc4-d7de2c5ffaef None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.229473 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.230100 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.230414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.230681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.233661 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6080d-065e-451c-b2b2-fcf6b4062664 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.233954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6080d-065e-451c-b2b2-fcf6b4062664 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.234265 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6080d-065e-451c-b2b2-fcf6b4062664 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.235731 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 407/799] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:35.237504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.238966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.240585 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.240864 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.241144 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:35.250783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:35.251697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:35.253097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:35.257411 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 393/800] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:35.258322 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.260000 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:35.261189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:35.275242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:35.302637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:35.331950 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 408/801] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:35.365698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab566b6a-c4a5-4e96-8215-c433bbaff533 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.402306 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.402913 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.403191 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.403462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.404144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:35.404444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.405866 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.418643 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 394/802] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:35.424983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.524870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdf18b-d81a-4378-a91d-b84023b74d22 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.557336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.557934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.558255 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.558523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/40be9e4af9564816886ec5e90519b330` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.560915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=4ae307c1cb064d0cb4b8b61cc5fe13d3, role_id=40be9e4af9564816886ec5e90519b330)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.562408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.576337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 409/803] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:35 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/4ae307c1cb064d0cb4b8b61cc5fe13d3/roles/40be9e4af9564816886ec5e90519b330 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:27:35.605085 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.715445 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:35.719781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844cd6f-a756-4384-84f9-5d0228856801 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.762462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.763346 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.763626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.763895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.764986 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.766461 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da64fa-40a4-4dda-b9c9-ddd1f6bb31fe None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.768817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 395/804] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:35.774482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:35.786558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:35.877948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cf434-467e-454e-87e9-56f0cfcee84e None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:35.911150 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:35.911754 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:35.912028 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:35.912295 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:35.912942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:35.914386 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f00e32-8675-4d9f-b70d-7a409333f15f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:35.936563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 410/805] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:27:35 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:36.189288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e27a1-59a7-499a-bcd7-48ba191a3448 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:36.190113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e27a1-59a7-499a-bcd7-48ba191a3448 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:36.190387 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e27a1-59a7-499a-bcd7-48ba191a3448 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:36.191862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 396/806] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:36.197019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:36.197303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:36.197574 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:36.215480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:36.216646 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:36.277105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:36.290326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 411/807] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:36.559025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e27a1-59a7-499a-bcd7-48ba191a3448 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:36.662360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e27a1-59a7-499a-bcd7-48ba191a3448 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:36.696989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:36.697591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:36.697863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:36.698129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:36.698893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:36.700257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:36.708631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.sql.core [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:36.708631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:27:36.708631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [parameters: {'id': 'b529a85066314524bebaddcc31a84717', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 14:27:36.708631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81562) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:36.716114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 14:27:36.716920 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application yield resource Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application next(self.gen) Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise self.value Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application session.commit() Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 14:27:36.717896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.session.flush() Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application compat.raise_( Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 14:27:36.718798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 14:27:36.719706 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application conn.query(q) Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application result.read() Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 14:27:36.720517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [parameters: {'id': 'b529a85066314524bebaddcc31a84717', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 14:27:36.721996 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:36.724820 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:36.727076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 397/808] 10.222.0.27 () {60 vars in 1137 bytes} [Wed Oct 12 14:27:36 2022] POST /identity/v3/domains => generated 190 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:36.730102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:36.826625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d83b-ebe9-48e4-9374-4d20c261bbeb None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:36.863713 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:36.864346 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:36.864694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:36.864895 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:36.874948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:36.876382 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-f8cc4908-f178-4c8a-80e7-4a65762cb049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:36.890900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:36.891819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:36.892716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:36.892716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:36.892716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:36.892716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 412/809] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:27:36.897961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:36.929287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:37.006811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae6e07-52ab-46a2-accf-67e3106897fc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:37.040468 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:37.041069 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:37.041343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:37.041612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:37.042266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:37.042637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:37.044007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800346bf-c5c0-4f87-9f59-f5d5b90db7f2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:37.058349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 398/810] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:37.719852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c38fc-b81c-49a0-a37a-b45f81ae11d0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:37.720130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c38fc-b81c-49a0-a37a-b45f81ae11d0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:37.720944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c38fc-b81c-49a0-a37a-b45f81ae11d0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:37.722311 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 413/811] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:37.727428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7ca5-852a-4d48-a049-696ed725757f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:37.727872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7ca5-852a-4d48-a049-696ed725757f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:37.727981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb7ca5-852a-4d48-a049-696ed725757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:37.746803 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-8cfb7ca5-852a-4d48-a049-696ed725757f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:37.747977 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8cfb7ca5-852a-4d48-a049-696ed725757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:37.814941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 399/812] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:38.081977 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c38fc-b81c-49a0-a37a-b45f81ae11d0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.108040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ea5-a3b9-4a9a-a64a-f0f0e827c72a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.108318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ea5-a3b9-4a9a-a64a-f0f0e827c72a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.108583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658ea5-a3b9-4a9a-a64a-f0f0e827c72a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.109907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 400/813] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:38.114681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.114961 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.115233 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.129761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.132972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:38.134197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:38.155258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.184364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c38fc-b81c-49a0-a37a-b45f81ae11d0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.205224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 401/814] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:27:38.217972 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.218704 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.219044 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.219374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.229779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:38.234559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:38.235695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:38.237200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 414/815] 10.222.0.27 () {56 vars in 1120 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:38.242362 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.338031 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a559956-c123-41b5-bca6-e89611f7f980 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.371672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.372264 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.372537 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.372802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.373446 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:38.373740 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.375136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.383149 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 402/816] 10.222.0.27 () {56 vars in 1115 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:38.388916 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.474338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.484797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089dd88-2eb3-4b1c-b274-930216d9e5f4 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.491934 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.492679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.520662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.521293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.521573 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.521844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.531840 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.533302 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:38.547547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:38.548603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:38.549553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:38.549553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:38.549553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:38.549553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 415/817] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:38.554428 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.578456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297efd02-f262-49e8-93bf-5f2c20732eff None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.611392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.611949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.612222 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.612490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.622610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:38.627894 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:38.628950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:38.629788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 403/818] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:38.635166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.655510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93f103-4057-49fc-9158-48379af532ef None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.689567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.690165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.690473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.690745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.691380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:38.691684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.693036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.704012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 416/819] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:38.707955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.710204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.729688 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.732553 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962b6f5-de81-4296-b4d7-fe89a09cf3bc None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.766242 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.766834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.767638 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.767908 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.768558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:38.768851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.770251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.778428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 404/820] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:38.784145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.808963 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3425d7-e755-4fb0-8c4c-e68a464c540f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.841304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.841921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.842221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.842497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.849669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.851110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:27:38.862502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:38.868332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 417/821] 10.222.0.27 () {56 vars in 1093 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:38.869475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.890407 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd222e-6790-4c4d-9ada-d0ee44247d18 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:38.924514 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:38.925135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:38.925415 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:38.925687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] PATH_INFO: `/v3/users/f2394b620aad437d8382cafee4f80bd9` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:38.928332 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.939498 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] RBAC: Authorizing `identity:get_user(user_id=f2394b620aad437d8382cafee4f80bd9)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:38.940926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:38.942565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 405/822] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/users/f2394b620aad437d8382cafee4f80bd9 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:38.946953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:38.948166 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:38.968596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff369f4-c38c-45f8-a4aa-d93ba28101f1 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.003153 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.003782 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.004057 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.004323 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.005035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:39.005589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.007034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.023792 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 418/823] 10.222.0.27 () {56 vars in 1133 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:39.029419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.050282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84933-1476-424a-8781-528f0aa9e836 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.083423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.084043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.084317 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.084586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.085676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] RBAC: Authorizing `identity:get_project(project_id=74e3085ffe6d4895ae89b288f5b66c12)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.087133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.088872 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 406/824] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:27:38 2022] GET /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:39.094458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.127482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b29e2-aae9-4391-84bc-4354d41add1d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.156853 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:39.164568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.165171 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.165446 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.165711 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.169013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:39.196256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deeefb6-1674-454d-932a-fd9cce943fed None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.230286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.230928 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.231204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.231471 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12/users/f2394b620aad437d8382cafee4f80bd9/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.233323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] RBAC: Authorizing `identity:create_grant(project_id=74e3085ffe6d4895ae89b288f5b66c12, user_id=f2394b620aad437d8382cafee4f80bd9, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.234194 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.234788 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.235683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.248088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 407/825] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:39 2022] PUT /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12/users/f2394b620aad437d8382cafee4f80bd9/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:27:39.341361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 419/826] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:39.347490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.453560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a31807-73d6-4040-9ab7-32f655fa0570 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.475403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:39.487764 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.488395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.488672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.488941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.498744 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.500187 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:27:39.515660 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:39.516817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:27:39.517802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:27:39.517802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:27:39.517802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:39.517802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 408/827] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:39.522468 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.555849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:39.618951 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba135b-605c-4a83-83ec-95ead85cbfc8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.651915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.652562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.652839 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.653104 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.653726 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:39.654019 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.655451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.666584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 420/828] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:27:39.671899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.771281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b626019-f1a2-4a3b-bbd2-19161ec40498 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.804497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.805111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.805385 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.805653 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.812124 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.813575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:27:39.824486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:39.825494 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:27:39.826430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:27:39.830272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 409/829] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:39.831334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:39.922690 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:39.929512 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3384a-6b58-4d9d-baf7-6228c9bbd08d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:39.963165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:39.963760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:39.964036 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:39.964301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:39.965030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:39.965327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:39.966778 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94ce14-0168-4623-950c-54fe41de5d37 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:39.978310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 421/830] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:39.984283 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:40.019258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:40.084034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d8fe4-185f-4d66-ae18-34b22ac0ab03 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:40.118401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:40.118998 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:40.119273 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:40.119541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:40.120258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] RBAC: Adding query filter params (role.id=40be9e4af9564816886ec5e90519b330, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:40.120560 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:40.121981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b7c6e-8e24-4d22-9380-cc52def34d8b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:40.127822 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 410/831] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:39 2022] GET /identity/v3/role_assignments?user.id=4ae307c1cb064d0cb4b8b61cc5fe13d3&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=40be9e4af9564816886ec5e90519b330 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:41.368159 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f359c1-2cee-45f3-a1fd-b79d77cb7659 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:41.368672 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f359c1-2cee-45f3-a1fd-b79d77cb7659 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:41.368672 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f359c1-2cee-45f3-a1fd-b79d77cb7659 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:41.369943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 422/832] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:41.375106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:41.375484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:41.376175 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:41.394813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:41.396006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:41.460575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 411/833] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:41.724605 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f359c1-2cee-45f3-a1fd-b79d77cb7659 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:41.822258 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f359c1-2cee-45f3-a1fd-b79d77cb7659 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:41.853813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:41.854445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:41.854723 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:41.854989 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:41.865228 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:27:41.869999 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:27:41.871107 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:27:41.872102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 423/834] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:27:41.877254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:41.904326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:41.973529 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47d6c-718b-4e1d-b8b3-d59806c9b7f3 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:42.007794 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:42.008395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:42.008671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:42.008940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:42.009591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:42.009889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:42.011306 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:42.019738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 412/835] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:42.025554 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:42.044067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:42.122241 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f79f1-7548-4418-8f47-5bdbb692506d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:42.154139 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:42.154774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:42.155052 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:42.155321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] PATH_INFO: `/v3/users/f2394b620aad437d8382cafee4f80bd9` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:42.156416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] RBAC: Authorizing `identity:get_user(user_id=f2394b620aad437d8382cafee4f80bd9)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:42.158396 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:42.159936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 424/836] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:42 2022] GET /identity/v3/users/f2394b620aad437d8382cafee4f80bd9 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:42.165447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:42.253386 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:42.263261 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de379100-4494-4ed0-9b60-af063144ab1a None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:42.295700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:42.296287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:42.296561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:42.296827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:42.362161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:42.363621 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:42.448065 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:42.458070 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 413/837] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:42.463829 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:42.543771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:42.559775 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d22b0d-60b2-441a-a422-74c33dac52b6 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:42.592758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:42.593375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:42.593653 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:42.593926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:42.595644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] RBAC: Authorizing `identity:get_project(project_id=74e3085ffe6d4895ae89b288f5b66c12)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:42.597056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20339b-95b5-404c-9415-52dfcdcef600 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:42.598691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 425/838] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:27:42 2022] GET /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:42.604741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:42.700097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e3183-710d-45ad-a432-a7c39dc1cc22 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:42.733383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:42.733968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:42.734271 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:42.734547 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:42.735255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=74e3085ffe6d4895ae89b288f5b66c12, user.id=f2394b620aad437d8382cafee4f80bd9) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:42.735559 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:42.736974 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a9b2e-7581-489f-8e91-e3182178f7e6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:42.742817 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 414/839] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:42 2022] GET /identity/v3/role_assignments?user.id=f2394b620aad437d8382cafee4f80bd9&scope.project.id=74e3085ffe6d4895ae89b288f5b66c12&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:44.855744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cacaf5-856c-4fa2-87ed-7dd2bf1a474f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:44.856312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cacaf5-856c-4fa2-87ed-7dd2bf1a474f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:44.856312 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cacaf5-856c-4fa2-87ed-7dd2bf1a474f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:44.857613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 426/840] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:27:44.863286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:44.863653 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:44.863830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:44.882349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:44.883526 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:44.930578 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:44.948175 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 415/841] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:45.216022 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cacaf5-856c-4fa2-87ed-7dd2bf1a474f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:45.314512 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cacaf5-856c-4fa2-87ed-7dd2bf1a474f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:45.346643 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:45.347253 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:45.347527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:45.347793 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:45.348876 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:45.350314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d2889-227f-426d-9226-45d6bfee96ce None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:45.352022 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 427/842] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:45.357435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:45.453343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5865e-6d3f-4d7c-866e-b1a7d70daaa5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:45.486275 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:45.486811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:45.487087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:45.487355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:45.487989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:45.489417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d22d51-7034-4596-9240-93db6c892eaf None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:45.511060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 416/843] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:27:45 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:27:47.671397 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd845-6d6e-49da-8217-b05604e3ddd0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:47.671921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd845-6d6e-49da-8217-b05604e3ddd0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:47.671921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fd845-6d6e-49da-8217-b05604e3ddd0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:47.673252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 428/844] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:47.678450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:47.678824 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:47.678999 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:47.697804 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:47.699019 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:47.731190 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:47.877355 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 417/845] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:48.147082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd845-6d6e-49da-8217-b05604e3ddd0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:48.168446 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:48.246727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fd845-6d6e-49da-8217-b05604e3ddd0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:48.280095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:48.280728 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:48.281008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:48.281282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] PATH_INFO: `/v3/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:48.282684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] RBAC: Authorizing `identity:get_role(role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:48.284041 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:48.285324 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 429/846] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:48 2022] GET /identity/v3/roles/e7fae3c65ae44410ade680c055bb291f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:48.291016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:48.385770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443036-8fa9-4274-9902-c457fcc4d634 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:48.417676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:48.418314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:48.418590 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:48.418858 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] PATH_INFO: `/v3/users/0bad80b408b640eeb62ccdd5c5d9270d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:48.431749 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] RBAC: Authorizing `identity:get_user(user_id=0bad80b408b640eeb62ccdd5c5d9270d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:48.433158 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:48.434731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 418/847] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:48 2022] GET /identity/v3/users/0bad80b408b640eeb62ccdd5c5d9270d => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:48.440884 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:48.525746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:48.537946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1261e76-c7f9-4d22-90ce-6c10a8782ec7 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:48.570807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:48.571420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:48.571700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:48.571973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:48.573064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] RBAC: Authorizing `identity:get_project(project_id=74e3085ffe6d4895ae89b288f5b66c12)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:48.574536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c619b4-5c03-4399-bbf8-9f916aabc57b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:48.576142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 430/848] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:27:48 2022] GET /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:48.581972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:48.609433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:48.679416 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d0174-0f7f-42b2-ac9a-a97595f7562c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:48.712299 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:48.712937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:48.713214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:48.713486 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12/users/0bad80b408b640eeb62ccdd5c5d9270d/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:48.715634 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] RBAC: Authorizing `identity:create_grant(project_id=74e3085ffe6d4895ae89b288f5b66c12, user_id=0bad80b408b640eeb62ccdd5c5d9270d, role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:48.717059 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80345409-7d1d-4c05-b1b5-b8c16b688cee None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:48.730284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 419/849] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:27:48 2022] PUT /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12/users/0bad80b408b640eeb62ccdd5c5d9270d/roles/e7fae3c65ae44410ade680c055bb291f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:27:50.817298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20233-7b9d-4cbe-aa2b-6a03f84d6d2b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:50.817821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20233-7b9d-4cbe-aa2b-6a03f84d6d2b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:50.817821 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a20233-7b9d-4cbe-aa2b-6a03f84d6d2b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:50.819185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 431/850] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:50.824354 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:50.824746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:50.824902 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:50.842881 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:50.844165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:50.908097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 420/851] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:51.177571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a20233-7b9d-4cbe-aa2b-6a03f84d6d2b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:51.277631 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a20233-7b9d-4cbe-aa2b-6a03f84d6d2b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:51.310366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:51.311004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:51.311282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:51.311550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] PATH_INFO: `/v3/roles/e7fae3c65ae44410ade680c055bb291f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:51.312915 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] RBAC: Authorizing `identity:get_role(role_id=e7fae3c65ae44410ade680c055bb291f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:51.314292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:51.315583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 432/852] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:51 2022] GET /identity/v3/roles/e7fae3c65ae44410ade680c055bb291f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:51.321232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:51.339338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:51.417671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc23f5e-c5e3-431f-913f-04e53dfd28d4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:51.449101 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:51.449711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:51.449985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:51.450278 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] PATH_INFO: `/v3/users/0bad80b408b640eeb62ccdd5c5d9270d` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:51.451845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] RBAC: Authorizing `identity:get_user(user_id=0bad80b408b640eeb62ccdd5c5d9270d)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:51.453250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:51.454830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 421/853] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:27:51 2022] GET /identity/v3/users/0bad80b408b640eeb62ccdd5c5d9270d => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:51.460498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:51.485442 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:51.557375 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dbfa6-cb7e-49d0-957f-6dcf3dba921a None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:51.589137 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:51.589718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:51.589993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:51.590287 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:51.653445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:51.654911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:51.678293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:51.751476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 433/854] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:27:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:27:51.757530 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:51.837776 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:51.853062 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838e98a-21a8-4705-aa19-245517ac1870 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:51.886051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:51.886685 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:51.886962 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:51.887230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] PATH_INFO: `/v3/projects/74e3085ffe6d4895ae89b288f5b66c12` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:51.888318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=74e3085ffe6d4895ae89b288f5b66c12)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:51.890345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af2bf6-c499-4470-adc3-d23614c6b5e1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:51.891940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 422/855] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:27:51 2022] GET /identity/v3/projects/74e3085ffe6d4895ae89b288f5b66c12 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:51.898054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:51.991590 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75812ca0-668b-4ec1-b445-7b82387efcb0 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:52.014560 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:52.025147 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:52.025743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:52.026024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:52.026321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:52.027030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] RBAC: Adding query filter params (role.id=e7fae3c65ae44410ade680c055bb291f, scope.project.id=74e3085ffe6d4895ae89b288f5b66c12, user.id=0bad80b408b640eeb62ccdd5c5d9270d) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:27:52.027332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:52.028743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1ccfd-f7b7-488b-9d6c-dd1a711dbc66 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:52.034757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 434/856] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:27:51 2022] GET /identity/v3/role_assignments?user.id=0bad80b408b640eeb62ccdd5c5d9270d&scope.project.id=74e3085ffe6d4895ae89b288f5b66c12&role.id=e7fae3c65ae44410ade680c055bb291f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:54.133208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbff7-a960-4de6-bcc0-b3484ec24c2a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:54.133806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbff7-a960-4de6-bcc0-b3484ec24c2a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:54.133806 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adbff7-a960-4de6-bcc0-b3484ec24c2a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:54.135090 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 423/857] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:54.140827 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:54.141257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:54.141379 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:54.159035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:54.160208 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:54.223291 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 435/858] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:54.487659 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adbff7-a960-4de6-bcc0-b3484ec24c2a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:54.584976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adbff7-a960-4de6-bcc0-b3484ec24c2a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:54.617026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:54.617628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:54.617899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:54.618164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:54.619267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:54.620682 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2630ea-66f0-442d-85b1-d258ddde8e85 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:54.622211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 424/859] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:54.628125 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:54.721499 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796d1e-f201-46f0-81eb-5bb59f478022 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:54.739485 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:54.756743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:54.757338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:54.757616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:54.757881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:54.758549 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:54.759962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1459643-22fe-41e2-85b2-cb4fdce3e8cd None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:54.785093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 436/860] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:27:54 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:27:56.918626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326b6e-00d7-4855-93bb-3ac0504e8c29 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:56.919179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326b6e-00d7-4855-93bb-3ac0504e8c29 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:56.919179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326b6e-00d7-4855-93bb-3ac0504e8c29 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:56.920485 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 425/861] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:56.925581 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:56.925993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:56.926122 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:56.943751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:56.944939 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:57.009761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 437/862] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:27:57.275504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e326b6e-00d7-4855-93bb-3ac0504e8c29 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:57.298987 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:57.374281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e326b6e-00d7-4855-93bb-3ac0504e8c29 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:57.406562 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:57.407171 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:57.407447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:57.407717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:57.408807 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:57.410240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b94efb-b1be-4d23-9ddf-981bb6b5f2ce None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:57.411767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 426/863] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:27:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:27:57.417453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:27:57.509321 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:27:57.512329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71021db-d11e-4c3d-8c77-917b5c0d5281 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:27:57.545185 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:27:57.545717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:57.545990 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:57.546282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:57.546921 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:27:57.548320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22949047-300b-45c9-a883-46d17fd2a76b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:27:57.571523 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 438/864] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:27:57 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:27:59.692705 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8139b-53c4-4947-96e9-eef6ec1b167f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:59.693266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8139b-53c4-4947-96e9-eef6ec1b167f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:59.693266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8139b-53c4-4947-96e9-eef6ec1b167f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:59.694594 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 427/865] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:27:59.700142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:27:59.700525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:27:59.700677 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:27:59.719525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:27:59.720691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:27:59.784315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 439/866] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:27:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:00.050830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8139b-53c4-4947-96e9-eef6ec1b167f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:00.137924 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:00.148748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8139b-53c4-4947-96e9-eef6ec1b167f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:00.182106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:00.182815 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:00.183092 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:00.183392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:00.193139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:28:00.197933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:28:00.199088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:28:00.200168 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 428/867] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:28:00.205004 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:00.288894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:00.306594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a1be0-a69a-4780-936e-ec640c6ab4a6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:00.341823 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:00.342463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:00.342741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:00.343006 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:00.343651 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:00.343947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:00.345289 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:00.353377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 440/868] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:00.360406 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:00.459593 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af244144-74fb-436b-ab48-60efd8dadcb3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:00.492845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:00.493466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:00.493739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:00.494006 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] PATH_INFO: `/v3/users/a2c77c734ca1409486ef8f69daf4dcf6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:00.506844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] RBAC: Authorizing `identity:get_user(user_id=a2c77c734ca1409486ef8f69daf4dcf6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:00.508280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:00.509851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 429/869] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:28:00 2022] GET /identity/v3/users/a2c77c734ca1409486ef8f69daf4dcf6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:00.516240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:00.612074 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41379c-9fc9-4eeb-85d1-12c21a54e5cf None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:00.644173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:00.644817 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:00.645095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:00.645364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] PATH_INFO: `/v3/projects/64a3ce8aa336431bb8cefeaa07de511f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:00.646492 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] RBAC: Authorizing `identity:get_project(project_id=64a3ce8aa336431bb8cefeaa07de511f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:00.647902 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95c361-9064-4492-86ec-4067cfa79e03 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:00.649493 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 441/870] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:28:00 2022] GET /identity/v3/projects/64a3ce8aa336431bb8cefeaa07de511f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:00.655232 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:00.665716 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:00.751559 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2ef5f-57a7-43bd-9dcf-ef3cd4d518ad None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:00.784451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:00.785084 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:00.785359 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:00.785630 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] PATH_INFO: `/v3/projects/64a3ce8aa336431bb8cefeaa07de511f/users/a2c77c734ca1409486ef8f69daf4dcf6/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:00.787505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] RBAC: Authorizing `identity:create_grant(project_id=64a3ce8aa336431bb8cefeaa07de511f, user_id=a2c77c734ca1409486ef8f69daf4dcf6, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:00.788923 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828200a9-1e17-4cdb-9937-a10be1ef69ae None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:00.801648 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 430/871] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:28:00 2022] PUT /identity/v3/projects/64a3ce8aa336431bb8cefeaa07de511f/users/a2c77c734ca1409486ef8f69daf4dcf6/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:28:02.873842 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa501d6-9c24-4260-8ec9-a616a1286644 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:02.874426 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa501d6-9c24-4260-8ec9-a616a1286644 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:02.874426 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa501d6-9c24-4260-8ec9-a616a1286644 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:02.876039 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 442/872] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:02.881125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:02.881556 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:02.881683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:02.900437 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:02.902288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:02.961365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:02.968268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 431/873] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:03.236053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa501d6-9c24-4260-8ec9-a616a1286644 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:03.255640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:03.336940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa501d6-9c24-4260-8ec9-a616a1286644 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:03.369146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:03.369765 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:03.370061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:03.370397 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:03.380423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:28:03.385188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:28:03.386927 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:28:03.388206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 443/874] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:28:03.392811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:03.487748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29333695-a240-41b3-ac79-8e96de5b38a2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:03.520456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:03.521043 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:03.521319 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:03.521588 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:03.522264 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:03.522563 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:03.523916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:03.532179 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 432/875] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:03.537813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:03.615318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:03.638475 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedfcd7-3b48-4377-adb7-ee1e1e22abff None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:03.671203 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:03.671812 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:03.672094 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:03.672366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] PATH_INFO: `/v3/users/a2c77c734ca1409486ef8f69daf4dcf6` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:03.673459 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] RBAC: Authorizing `identity:get_user(user_id=a2c77c734ca1409486ef8f69daf4dcf6)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:03.674901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:03.676506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 444/876] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:28:03 2022] GET /identity/v3/users/a2c77c734ca1409486ef8f69daf4dcf6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:03.682440 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:03.740427 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:03.781515 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c537d1-8e87-43d2-8c15-443d26cba47e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:03.813687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:03.814302 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:03.814581 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:03.814850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:03.880165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:03.881613 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:03.936689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:03.976335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 433/877] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:28:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:28:03.982356 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:04.078675 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534c6c3-7ab4-4f1e-87f2-42c4a9c0c16f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:04.110502 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:04.111116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:04.111392 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:04.111660 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] PATH_INFO: `/v3/projects/64a3ce8aa336431bb8cefeaa07de511f` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:04.112747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] RBAC: Authorizing `identity:get_project(project_id=64a3ce8aa336431bb8cefeaa07de511f)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:04.114155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e2a17-bf10-4421-a1b2-58b3b46a76db None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:04.115782 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 445/878] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:28:03 2022] GET /identity/v3/projects/64a3ce8aa336431bb8cefeaa07de511f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:04.122440 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:04.217687 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bf507-39e0-4207-a948-c92e1c94518e None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:04.250856 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:04.251383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:04.251664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:04.251937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:04.252649 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=64a3ce8aa336431bb8cefeaa07de511f, user.id=a2c77c734ca1409486ef8f69daf4dcf6) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:04.252957 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:04.254540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8df159-2e90-4bac-bcb3-349e5a9f24fa None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:04.260087 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 434/879] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:28:04 2022] GET /identity/v3/role_assignments?user.id=a2c77c734ca1409486ef8f69daf4dcf6&scope.project.id=64a3ce8aa336431bb8cefeaa07de511f&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:06.366521 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41c507-b197-4d18-90ee-d3ea478ff5a8 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:06.367043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41c507-b197-4d18-90ee-d3ea478ff5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:06.367043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41c507-b197-4d18-90ee-d3ea478ff5a8 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:06.368337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 446/880] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:06.374159 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a37f9-9ea8-4858-93e2-c77b10dbb513 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:06.374825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a37f9-9ea8-4858-93e2-c77b10dbb513 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:06.374982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a37f9-9ea8-4858-93e2-c77b10dbb513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:06.392587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3f3a37f9-9ea8-4858-93e2-c77b10dbb513 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:06.393748 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3f3a37f9-9ea8-4858-93e2-c77b10dbb513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:06.410311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:06.458869 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 435/881] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:06.730863 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41c507-b197-4d18-90ee-d3ea478ff5a8 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:06.745958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:06.829707 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41c507-b197-4d18-90ee-d3ea478ff5a8 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:06.862721 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:06.863316 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:06.863597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:06.863872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:06.864538 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:06.865929 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34024cc-b20a-4b6b-b950-b5d0b289de22 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:06.880835 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 447/882] 10.222.0.27 () {60 vars in 1138 bytes} [Wed Oct 12 14:28:06 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:28:09.008015 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814c5b-d424-45fe-8ee1-665fdc2b3bf9 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:09.008500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814c5b-d424-45fe-8ee1-665fdc2b3bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:09.008599 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88814c5b-d424-45fe-8ee1-665fdc2b3bf9 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:09.009877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 436/883] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:09.014975 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:09.015398 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:09.015531 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:09.033725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:09.034940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:09.098500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 448/884] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:09.367234 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88814c5b-d424-45fe-8ee1-665fdc2b3bf9 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:09.464713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88814c5b-d424-45fe-8ee1-665fdc2b3bf9 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:09.496112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:09.496716 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:09.496989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:09.497256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] PATH_INFO: `/v3/domains/122ef7ed41424b18956152fa5374d75e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:09.507398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=122ef7ed41424b18956152fa5374d75e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:09.508818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedf56e-9ee4-4a6e-bffe-01e366e47bd3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:09.510887 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 437/885] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Oct 12 14:28:09 2022] GET /identity/v3/domains/122ef7ed41424b18956152fa5374d75e => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:09.516549 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:09.518753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:09.613130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f18a2-ae3b-4017-bd4a-cc13d46fa89a None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:09.645712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:09.646282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:09.646562 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:09.646831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:09.647466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:09.648877 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710860b5-5844-4f20-834d-f3e268e02ad1 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:09.675344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 449/886] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:28:09 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:28:11.814856 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f234-ea68-423f-b491-97dfd7f0bd7a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:11.815405 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f234-ea68-423f-b491-97dfd7f0bd7a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:11.815405 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984f234-ea68-423f-b491-97dfd7f0bd7a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:11.816714 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 438/887] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:11.822349 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:11.822759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:11.822891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:11.841095 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:11.842288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:11.889691 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:11.911396 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 450/888] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:12.179144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f234-ea68-423f-b491-97dfd7f0bd7a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:12.195518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:12.280280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984f234-ea68-423f-b491-97dfd7f0bd7a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:12.312664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:12.313280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:12.313558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:12.313830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] PATH_INFO: `/v3/domains/122ef7ed41424b18956152fa5374d75e` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:12.314960 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] RBAC: Authorizing `identity:get_domain(domain_id=122ef7ed41424b18956152fa5374d75e)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:12.316382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de14a4-98c5-47a8-8406-7c4f6eb9582c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:12.317922 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 439/889] 10.222.0.27 () {56 vars in 1183 bytes} [Wed Oct 12 14:28:12 2022] GET /identity/v3/domains/122ef7ed41424b18956152fa5374d75e => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:12.324437 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:12.420303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8591d27-8279-4fcf-a2f9-e5b5c8d06c78 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:12.453772 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:12.454395 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:12.454681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:12.454953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:12.455602 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:12.457012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c83cb-b720-4e50-9314-d6f2b1707b88 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:12.477732 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 451/890] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:28:12 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:28:14.626452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250011-a64a-4688-b9ee-2fd7ad79b228 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:14.626992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250011-a64a-4688-b9ee-2fd7ad79b228 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:14.626992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55250011-a64a-4688-b9ee-2fd7ad79b228 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:14.628328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 440/891] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:14.633585 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:14.633996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:14.634124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:14.651701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:14.652865 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:14.686390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:14.718454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 452/892] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:14.987736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55250011-a64a-4688-b9ee-2fd7ad79b228 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:15.067696 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:15.086814 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55250011-a64a-4688-b9ee-2fd7ad79b228 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:15.118895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:15.119507 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:15.119781 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:15.120047 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:15.130409 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:28:15.135272 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:28:15.136424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:28:15.137596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 441/893] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:28:15.142366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:15.236809 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827c70-42d6-47a0-927a-1e6177477b40 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:15.268995 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:15.269535 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:15.269815 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:15.270089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:15.270779 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:15.271081 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:15.272448 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:15.282983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 453/894] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:15.288730 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:15.386042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777a38b-2c33-4461-a3a9-f739bcb2a1d1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:15.418284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:15.418892 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:15.419170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:15.419438 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] PATH_INFO: `/v3/users/8f6ffe1759e24e2e86d4d4cb7c196cfe` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:15.430061 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:15.432676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] RBAC: Authorizing `identity:get_user(user_id=8f6ffe1759e24e2e86d4d4cb7c196cfe)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:15.434298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:15.436022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 442/895] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:28:15 2022] GET /identity/v3/users/8f6ffe1759e24e2e86d4d4cb7c196cfe => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:15.441600 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:15.472988 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:15.538991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028cf5a-1623-49f4-bc3a-695f1707eb2f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:15.570550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:15.571741 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:15.572026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:15.572298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] PATH_INFO: `/v3/projects/a55b66c0e9254abe88e62b8352c5c03a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:15.573400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] RBAC: Authorizing `identity:get_project(project_id=a55b66c0e9254abe88e62b8352c5c03a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:15.574846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ebea1-73d6-4c40-b1ae-fcd98d963073 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:15.576447 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 454/896] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:28:15 2022] GET /identity/v3/projects/a55b66c0e9254abe88e62b8352c5c03a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:15.582222 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:15.678275 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7ee95-a72d-4097-9247-0cb46e70deae None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:15.712833 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:15.713464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:15.713738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:15.714012 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] PATH_INFO: `/v3/projects/a55b66c0e9254abe88e62b8352c5c03a/users/8f6ffe1759e24e2e86d4d4cb7c196cfe/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:15.715878 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a55b66c0e9254abe88e62b8352c5c03a, user_id=8f6ffe1759e24e2e86d4d4cb7c196cfe, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:15.717285 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6f711-1394-4468-b75d-07130c8493b8 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:15.729356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 443/897] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:28:15 2022] PUT /identity/v3/projects/a55b66c0e9254abe88e62b8352c5c03a/users/8f6ffe1759e24e2e86d4d4cb7c196cfe/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:28:17.841092 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41355e0-d582-4a7b-a6f9-260d7030c722 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:17.841652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41355e0-d582-4a7b-a6f9-260d7030c722 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:17.841652 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41355e0-d582-4a7b-a6f9-260d7030c722 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:17.843031 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 455/898] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:28:17.848373 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:17.848770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:17.848927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:17.866760 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:28:17.868017 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:28:17.922141 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:17.934067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 444/899] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:28:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:28:18.204594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41355e0-d582-4a7b-a6f9-260d7030c722 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:18.298605 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:18.302712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41355e0-d582-4a7b-a6f9-260d7030c722 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:18.335739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:18.336345 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:18.336619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:18.336887 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:18.346601 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:28:18.351344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:28:18.352443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:28:18.353500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 456/900] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:28:18.358823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:18.454841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7eed7-8537-4781-9ed1-9ddb8873b29e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:18.487111 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:18.487695 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:18.487967 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:18.488231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:18.488873 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:18.489167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:18.490535 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:18.498821 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 445/901] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:18.504924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:18.600161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85b477-0dd4-48a1-af09-44b392964cdd None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:18.633606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:18.634230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:18.634508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:18.634774 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] PATH_INFO: `/v3/users/8f6ffe1759e24e2e86d4d4cb7c196cfe` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:18.636365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] RBAC: Authorizing `identity:get_user(user_id=8f6ffe1759e24e2e86d4d4cb7c196cfe)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:18.637766 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:18.639330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 457/902] 10.222.0.27 () {56 vars in 1177 bytes} [Wed Oct 12 14:28:18 2022] GET /identity/v3/users/8f6ffe1759e24e2e86d4d4cb7c196cfe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:18.645108 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:18.695787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:18.741718 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53ea1f-9aba-4752-adbe-5e10c7625b3b None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:18.773883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:18.774495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:18.774767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:18.775032 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:18.839298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:18.840720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:18.889683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:18.935339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 446/903] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:28:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:28:18.941141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:18.968699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:19.037187 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28005af1-7a28-41a5-affd-bfa671e35157 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:19.069555 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:19.070167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:19.070468 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:19.070736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] PATH_INFO: `/v3/projects/a55b66c0e9254abe88e62b8352c5c03a` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:19.071816 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] RBAC: Authorizing `identity:get_project(project_id=a55b66c0e9254abe88e62b8352c5c03a)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:19.073231 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1559-c58a-4ffb-8aa1-480e41d5cf27 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:19.075366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 458/904] 10.222.0.27 () {56 vars in 1186 bytes} [Wed Oct 12 14:28:18 2022] GET /identity/v3/projects/a55b66c0e9254abe88e62b8352c5c03a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:19.081444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:28:19.178404 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd54a9-7e2c-43d4-b42a-aa7af4abf16c None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:28:19.211312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:28:19.211899 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:28:19.212178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:28:19.212453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:28:19.213167 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=a55b66c0e9254abe88e62b8352c5c03a, user.id=8f6ffe1759e24e2e86d4d4cb7c196cfe) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:28:19.213474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:28:19.214995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b2ac7-0496-46a6-94ea-1ecbc44818e7 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:28:19.220619 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 447/905] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:28:19 2022] GET /identity/v3/role_assignments?user.id=8f6ffe1759e24e2e86d4d4cb7c196cfe&scope.project.id=a55b66c0e9254abe88e62b8352c5c03a&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:28:29.065747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=52 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:28:29.218079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=92 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:14.184889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c36a0-5447-4055-a346-5788d3e38371 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:14.184889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c36a0-5447-4055-a346-5788d3e38371 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:14.184889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c36a0-5447-4055-a346-5788d3e38371 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:14.186100 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 459/906] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:14.191448 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:14.192019 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:14.192019 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:14.230138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:14.231757 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:14.335475 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 448/907] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:14.622216 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c36a0-5447-4055-a346-5788d3e38371 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:14.745844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c36a0-5447-4055-a346-5788d3e38371 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:14.787662 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:14.788430 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:14.788708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:14.788976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:14.802183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:14.803908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:14.823224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:14.824650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:14.825941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:14.825941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:14.825941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:14.828000 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 460/908] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:14.834201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:14.968689 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ec87-2d14-4e91-a742-46d40baaf153 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:15.008972 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:15.016093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:15.016741 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:15.017037 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:15.017291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:15.017970 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:15.018281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:15.019673 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4915b-aa8c-48b3-b0c0-56b6aeb97d52 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:15.038654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 449/909] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:15.044209 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:15.129278 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:15.190683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193095-2159-44f3-b1e9-c58e9abe6320 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:15.228966 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:15.229515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:15.229812 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:15.230052 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:15.230745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:15.232170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63a535-3c7b-41c9-a33f-25d3f47f1cc0 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:15.253717 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 461/910] 10.222.0.27 () {60 vars in 1132 bytes} [Wed Oct 12 14:29:15 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 14:29:17.514382 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec103e8-6558-4722-a5ed-06fed5958d4d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:17.514965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec103e8-6558-4722-a5ed-06fed5958d4d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:17.514965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec103e8-6558-4722-a5ed-06fed5958d4d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:17.516289 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 450/911] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:17.522393 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:17.522814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:17.522926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:17.542264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:17.543473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:17.616401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 462/912] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:17.911392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec103e8-6558-4722-a5ed-06fed5958d4d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:18.045490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec103e8-6558-4722-a5ed-06fed5958d4d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:18.086409 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:18.087451 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:18.087736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:18.088113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:18.100447 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:29:18.105816 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:18.106813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:18.110932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 451/913] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:18.113604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:18.168839 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:18.239682 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d2eb5-6f30-435c-82ba-396d3f8b8edc None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:18.284961 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:18.286162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:18.286431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:18.286735 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:18.287838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:18.287838 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:18.289110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:18.298849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 463/914] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:18.305604 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:18.363952 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:18.431941 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fe335-2682-40e9-b51c-09f785eaa746 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:18.475524 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:18.476159 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:18.476434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:18.476703 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:18.490200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:18.492058 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:18.510432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:18.516543 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:18.517439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:18.517439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:18.517439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:18.517439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 452/915] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:18.519365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:18.640594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:18.643909 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ec0d2-c78e-49e0-832e-ca7fbde9ca2d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:18.682685 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:18.683219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:18.683496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:18.683768 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:18.684407 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:18.684708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:18.686073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:18.700227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 464/916] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:18.705649 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:18.829350 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62634cd-a146-4858-a7f4-486984e9b0f2 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:18.831516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:18.873827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:18.874517 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:18.874818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:18.875070 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:18.885868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:18.887417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:29:18.902662 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:18.905197 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:18.906308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 453/917] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:29:18.911182 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:19.053440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a949c3-7bb4-4a38-985e-d7472d1f9aa8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:19.096151 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:19.096875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:19.097219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:19.097550 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:19.098380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:19.098761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:19.102305 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:19.120746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 465/918] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 12 14:29:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:19.127228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:19.254999 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8af98-8103-4f7f-a527-e1dd4a00bf48 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:19.291904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:19.292536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:19.292810 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:19.293078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:19.304909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:19.306403 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:19.321940 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:19.323255 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:19.324459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:19.324459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:19.324459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:19.324459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 454/919] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:19.329094 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:19.352521 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:19.442712 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8b5b6-dd5b-4e43-97f8-94a47c0c762f None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:19.480514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:19.481236 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:19.481594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:19.481941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:19.482708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:19.483141 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:19.484665 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:19.498262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 466/920] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:19.504004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:19.520396 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:19.632639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57752ed-fa64-448d-8dc4-d0f8a26cfc95 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:19.678574 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:19.679244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:19.679524 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:19.679774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:19.688761 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:19.690310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:29:19.705114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:19.706345 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:19.712508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 455/921] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:19.713048 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:19.805007 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:19.831649 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716339c3-489c-4e17-90ee-fab6239feb69 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:19.881964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:19.882625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:19.882911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:19.883187 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:19.884791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:19.884791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:19.885622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165d16-da10-41a4-86c8-bda70f7dd98e None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:19.906820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 467/922] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:19.908150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:20.007558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:20.037348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d3a6-ac0a-4c68-8824-3b139c05c5f6 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:20.080681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:20.081546 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:20.082079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:20.082488 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/77caa3ee5f55410084f1d978dca4c749/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:20.101493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=77caa3ee5f55410084f1d978dca4c749, role_id=69f12e8bcc314bd3bcd4f9c20a5c43e5)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:20.103200 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c42a1-696a-4545-b486-1da532cbf6cd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:20.116208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 456/923] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:29:19 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/77caa3ee5f55410084f1d978dca4c749/roles/69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:29:22.308376 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa516-286b-4b6f-a727-caaf492d5c37 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:22.308924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa516-286b-4b6f-a727-caaf492d5c37 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:22.308924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aa516-286b-4b6f-a727-caaf492d5c37 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:22.310193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 468/924] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:22.315331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:22.315720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:22.315880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:22.333813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:22.335068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:22.404352 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 457/925] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:22.676561 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aa516-286b-4b6f-a727-caaf492d5c37 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:22.789377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aa516-286b-4b6f-a727-caaf492d5c37 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:22.829680 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:22.830344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:22.830725 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:22.830994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:22.838163 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:22.842505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:29:22.848361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:22.849466 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:22.851257 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 469/926] 10.222.0.27 () {56 vars in 1102 bytes} [Wed Oct 12 14:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:29:22.856331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:22.920098 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:22.973082 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8bf50-d2d0-4381-b973-4fc002ed72ff None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.017212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.017823 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.018104 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.018410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:23.019073 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] RBAC: Adding query filter params (name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:23.019375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:23.021048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:23.031169 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 458/927] 10.222.0.27 () {56 vars in 1103 bytes} [Wed Oct 12 14:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:23.037457 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:23.154308 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde91cf9-3144-4b99-9a92-995b2ae0bd20 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.193903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.195217 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.195525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.195819 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:23.207669 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:23.209596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:23.228804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:23.230700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:23.231814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:23.231814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:23.231814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:23.231814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 470/928] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:23.235829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:23.353025 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1629fab-938a-40bb-b6e4-ad2821082048 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.375739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:23.402760 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.403436 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.403742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.403986 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:23.404724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:23.405031 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:23.406731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:23.419991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 459/929] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:23.426042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:23.483954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:23.544548 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd48563-3054-4ac6-a44f-67d7ec49584d None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.580532 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.581174 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.581456 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.581720 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:23.590133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:23.591594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:29:23.603890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:23.604852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:23.605813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 471/930] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:23.611263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:23.732374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1cedb-b816-4005-afb9-0df273da52d0 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.771979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.773343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.773652 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.773949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:23.774932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:23.775239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:23.777349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:23.800907 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 460/931] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 12 14:29:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:23.808528 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:23.927098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d505c-3a22-451f-966d-900e41f9ff24 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:23.937924 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:23.971335 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:23.972117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:23.972435 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:23.972710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:24.048826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:24.050224 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:24.157926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 472/932] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:29:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:29:24.164320 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:24.202680 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:24.282558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe2549-7491-4128-9157-1bf8106f47ee None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:24.319698 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:24.320430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:24.320805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:24.321083 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:24.332959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:24.334715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:24.352410 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:24.354010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:24.355189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:24.355189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:24.355189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:24.355189 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 461/933] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:24.359798 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:24.372218 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:24.472507 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae273-b63e-48be-82bf-c1266252e2b8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:24.510841 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:24.511446 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:24.511724 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:24.511995 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:24.512633 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:24.512942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:24.514329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:24.525526 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 473/934] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:24.532239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:24.633997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:24.650639 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772f3f-af1a-417c-a358-de302da9f9b3 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:24.685561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:24.686252 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:24.686607 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:24.686880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:24.694997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:24.696715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:29:24.708150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:24.709136 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:24.710982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 462/935] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:24.716337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:24.793587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:24.832791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c35fa-01ff-4299-9a7a-4bb7b8f36783 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:24.871694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:24.872309 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:24.872591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:24.872862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:24.873553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:24.873862 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:24.875327 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff8b82-b4b7-449a-99de-346f20452731 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:24.888747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 474/936] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:24.894927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:25.007281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b075287-ac5d-4cf6-8cd0-395f5aa872db None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:25.044286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:25.044886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:25.045165 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:25.045433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:25.046150 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] RBAC: Adding query filter params (role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=77caa3ee5f55410084f1d978dca4c749) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:25.046487 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:25.047982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894994b-6161-477b-85cd-5ef65c32ae5c None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:25.053702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 463/937] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:29:24 2022] GET /identity/v3/role_assignments?user.id=77caa3ee5f55410084f1d978dca4c749&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=69f12e8bcc314bd3bcd4f9c20a5c43e5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 14:29:27.544990 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed2b4-2370-4c00-9880-bbf52cbba766 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:27.545558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed2b4-2370-4c00-9880-bbf52cbba766 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:27.545558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ed2b4-2370-4c00-9880-bbf52cbba766 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:27.546965 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 475/938] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:27.555654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:27.556106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:27.556204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:27.577240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:27.578605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:27.582609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:27.662208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 464/939] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:29:27.950527 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed2b4-2370-4c00-9880-bbf52cbba766 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.076066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ed2b4-2370-4c00-9880-bbf52cbba766 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:28.111089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:28.118826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:28.119465 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:28.119749 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:28.120018 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:28.130558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:29:28.135830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:28.136973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:28.138064 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 476/940] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:28.143056 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.246342 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad5be-9968-403d-8515-ef52dc49a4ae None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:28.292904 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:28.293518 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:28.293795 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:28.294063 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:28.294775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:28.295079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:28.296449 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:28.304702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 465/941] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:28.310634 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.421390 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794c06-e78f-4c30-ac2d-2860202a245c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:28.459657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:28.460294 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:28.460611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:28.460894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:28.473191 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:28.475202 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:28.493306 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:28.494411 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:28.495364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:28.495364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:28.495364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:28.495364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 477/942] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 14:29:28.501329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.504408 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:28.621318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c86d7-811d-4608-beac-26e9d0fac336 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:28.664914 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:28.665661 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:28.665983 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:28.666363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:28.667135 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:28.667505 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:28.669045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:28.684520 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 466/943] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:28.690785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.743197 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:28.810361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce706a-0c5b-45d5-bde8-93c295fb72eb None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:28.847536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:28.848288 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:28.848636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:28.849024 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:28.859559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:28.861606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:29:28.876186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:28.877370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:28.878583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:28.882233 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 478/944] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:28.883322 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:28.949925 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:29.003084 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10742b1a-4fda-43eb-9541-029dc252c76f None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.045582 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.046329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.046606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.046875 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] PATH_INFO: `/v3/users` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.047675 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:29.047978 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.049450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.068792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 467/945] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 12 14:29:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:29.075165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:29.194389 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3ed8-0737-4ed1-90d6-3a13ebeeb378 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.196454 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:29.231960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.232812 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.233220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.233567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.246690 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.248374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:29.266623 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:29.267740 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:29.268637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:29.268637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:29.268637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:29.268637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 479/946] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:29.274333 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:29.386114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67c5a2-d116-497e-acf8-6b0a71fe9608 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.410990 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:29.428308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.428919 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.429264 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.429481 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.430998 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:29.431300 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.433170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.447126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 468/947] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:29.453138 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:29.566471 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa962d20-dc20-4470-bc3a-3f3139a58e46 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.615405 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.616473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.616973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.617867 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.625657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.627142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:29:29.640955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:29.642055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:29.648752 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 480/948] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:29.649241 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:29.771777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeba96-cf3c-4ef7-b55f-79231960b4fd None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.811470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.812121 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.812390 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.812737 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.813537 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:29.813801 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.815270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2672f-c546-4bfc-9ad6-25a092e0fb5f None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.828126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 469/949] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:29.834529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:29.851313 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:29.945619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e16cc-c6a9-48b4-8f28-efcfcaa55338 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:29.980389 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:29.981066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] REQUEST_METHOD: `PUT` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:29.981346 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:29.981619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] PATH_INFO: `/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/77caa3ee5f55410084f1d978dca4c749/roles/d732cf042b7f4ce2b7a7e853f68a4ba6` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:29.983630 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] RBAC: Authorizing `identity:create_grant(project_id=732d5898e7be4bcc948bdf59ffa4dc68, user_id=77caa3ee5f55410084f1d978dca4c749, role_id=d732cf042b7f4ce2b7a7e853f68a4ba6)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:29.985067 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0fe8f-57d6-4e37-aa64-bff55127be98 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:29.999110 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 481/950] 10.222.0.27 () {58 vars in 1439 bytes} [Wed Oct 12 14:29:29 2022] PUT /identity/v3/projects/732d5898e7be4bcc948bdf59ffa4dc68/users/77caa3ee5f55410084f1d978dca4c749/roles/d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 14:29:32.470906 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04d62-c964-47ef-943c-5157708bbe4a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:32.471426 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04d62-c964-47ef-943c-5157708bbe4a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:32.471524 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d04d62-c964-47ef-943c-5157708bbe4a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:32.472863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 470/951] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:32.479247 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:32.479693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:32.479785 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:32.498744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:32.500089 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:32.576154 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 482/952] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 14:29:32.871615 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d04d62-c964-47ef-943c-5157708bbe4a None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:32.919850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:32.982541 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d04d62-c964-47ef-943c-5157708bbe4a None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.021474 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.022161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.022503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.022771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.034257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 14:29:33.039277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:33.040439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:33.041632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 471/953] 10.222.0.27 () {56 vars in 1096 bytes} [Wed Oct 12 14:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:33.046563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.049747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:33.155987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbe652-b893-4d22-a74e-a725308cca76 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.192952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.193600 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.193931 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.194156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.194909 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:33.195235 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:33.197285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:33.206051 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 483/954] 10.222.0.27 () {56 vars in 1099 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:33.212428 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.320354 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:33.324846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c47e7-d385-453d-a80d-464b565ce502 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.365245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.366003 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.366329 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.366606 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.378624 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:33.380115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:33.397128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:33.403457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:33.404566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:33.404566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:33.404566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:33.404566 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 472/955] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:33.404853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.472974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:33.511342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f647a-8521-43a6-a597-479f59b7c37c None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.547065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.547685 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.547964 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.548237 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.548888 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:33.549189 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:33.550604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:33.563637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 484/956] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:33.569439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.688799 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d025-f778-4895-8ecf-d276e9bc9c98 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.725298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.725855 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.726190 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.726490 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.736414 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:33.738320 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 14:29:33.750370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:33.751464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:33.752500 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 473/957] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:33.758071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.860871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c2ef6-1405-46ba-bab9-05c1dd8c17b8 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:33.888808 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:33.898822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:33.899995 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:33.900337 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:33.900611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:33.901349 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:33.901657 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:33.903156 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:33.921644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 485/958] 10.222.0.27 () {56 vars in 1143 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:33.927138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:33.943005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:34.032916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ec55-3b24-442f-8be8-e80292365a29 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.065483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.066080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.066388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.066664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.130394 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.131835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:34.145099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:34.226860 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 474/959] 10.222.0.27 () {58 vars in 1282 bytes} [Wed Oct 12 14:29:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 14:29:34.233243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:34.330903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617792-8b55-438a-8e47-41f2ecd20fad None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.363192 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.363807 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.364084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.364354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.374528 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.375954 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 14:29:34.390729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:34.391797 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 14:29:34.392820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 14:29:34.392820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 14:29:34.392820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:34.392820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 486/960] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:34.397420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:34.492076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b103787-e512-4917-8aba-33a25f6a2e5d None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.505091 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:34.525839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.526463 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.526737 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.527002 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] PATH_INFO: `/v3/domains` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.527624 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:34.527919 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.529265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:34.541237 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 475/961] 10.222.0.27 () {56 vars in 1109 bytes} [Wed Oct 12 14:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:34.546679 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:34.581890 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:34.656526 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94eee0d-b9c9-4b27-a199-3481407b9d05 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.688973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.689584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.689859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.690129 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.697082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.698546 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 14:29:34.709366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:34.710391 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: ERROR keystone.server.flask.application Oct 12 14:29:34.711710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 487/962] 10.222.0.27 () {56 vars in 1111 bytes} [Wed Oct 12 14:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:34.716331 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:34.812171 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed224-bc94-4999-b867-0e132f6d8eac None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.844742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.845265 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.845538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.845804 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.846504 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:34.846802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.848218 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e484c1-95c2-46a6-8db2-ee9b0fa35d1e None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:34.860151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 476/963] 10.222.0.27 () {56 vars in 1148 bytes} [Wed Oct 12 14:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:34.865943 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:34.957245 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:34.963404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd0f6-de02-40ce-a485-9c7bef566886 None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:34.996358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:34.996951 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:34.997229 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:34.997499 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:34.998232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] RBAC: Adding query filter params (role.id=d732cf042b7f4ce2b7a7e853f68a4ba6, scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68, user.id=77caa3ee5f55410084f1d978dca4c749) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:34.998540 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:34.999955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b6932-eb12-43b2-bba0-03f49fe442a6 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:35.005515 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 488/964] 10.222.0.27 () {56 vars in 1374 bytes} [Wed Oct 12 14:29:34 2022] GET /identity/v3/role_assignments?user.id=77caa3ee5f55410084f1d978dca4c749&scope.project.id=732d5898e7be4bcc948bdf59ffa4dc68&role.id=d732cf042b7f4ce2b7a7e853f68a4ba6 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:37.133645 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be24c-ca25-448f-a86e-3e4e340d2b04 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:37.134251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be24c-ca25-448f-a86e-3e4e340d2b04 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:37.134251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09be24c-ca25-448f-a86e-3e4e340d2b04 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:37.135576 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 477/965] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:37.140761 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:37.141174 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:37.141298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:37.159264 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:37.160443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:37.224350 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 489/966] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:37.486620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be24c-ca25-448f-a86e-3e4e340d2b04 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:37.517307 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:37.591340 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09be24c-ca25-448f-a86e-3e4e340d2b04 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:37.632584 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:37.633312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:37.633621 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:37.633976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:37.634717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:37.636354 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:37.647113 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:37.648202 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:37.649075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 478/967] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:29:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:37.655616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:37.742240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:37.751459 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc66715-27f3-42f8-aad3-920a03568fca None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:37.784093 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:37.784685 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:37.784960 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:37.785231 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:37.785869 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:37.786167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:37.787544 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7e549-fd18-4936-934f-db392491eb0b None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:37.792729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 490/968] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 12 14:29:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:37.798318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:37.890116 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:37.896452 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1546d1-9ae1-4e0d-9a97-9e6a2a68d5a5 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:37.930465 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:37.931053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:37.931328 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:37.931596 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] PATH_INFO: `/v3/services` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:37.932212 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:37.932508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:37.933862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23365b1-702f-4c65-a65c-05440afdcc34 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:37.938234 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 479/969] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 12 14:29:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:40.050831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12ab5-f02e-4699-9496-67f7099cbec5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:40.051271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12ab5-f02e-4699-9496-67f7099cbec5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:40.051381 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e12ab5-f02e-4699-9496-67f7099cbec5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:40.052696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 491/970] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:40.058311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871abc-4005-4de4-83b0-09a8b0a9131b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:40.058674 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871abc-4005-4de4-83b0-09a8b0a9131b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:40.058863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871abc-4005-4de4-83b0-09a8b0a9131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:40.077151 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-f7871abc-4005-4de4-83b0-09a8b0a9131b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:40.078372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-f7871abc-4005-4de4-83b0-09a8b0a9131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:40.141930 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 480/971] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:40.410496 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12ab5-f02e-4699-9496-67f7099cbec5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:40.507117 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e12ab5-f02e-4699-9496-67f7099cbec5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:40.539556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:40.540143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:40.540421 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:40.540690 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:40.541332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:40.542739 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea120c8-0045-4887-8980-b6a08c0e5d42 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:40.556751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 492/972] 10.222.0.27 () {60 vars in 1141 bytes} [Wed Oct 12 14:29:40 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:29:42.681024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe96f5-0f18-480c-9c98-942f3cccf10c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:42.681765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe96f5-0f18-480c-9c98-942f3cccf10c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:42.681765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe96f5-0f18-480c-9c98-942f3cccf10c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:42.682936 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 481/973] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:42.688210 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:42.688655 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:42.688753 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:42.707446 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:42.708611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:42.718251 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:42.779495 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 493/974] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:43.045959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe96f5-0f18-480c-9c98-942f3cccf10c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:43.135266 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:43.145809 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe96f5-0f18-480c-9c98-942f3cccf10c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:43.179080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:43.179690 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:43.179966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:43.180242 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:43.180811 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:43.182217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:43.190848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:43.192068 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:43.192991 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 482/975] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:29:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:43.198280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:43.299591 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295e010-5b88-4f32-9237-a0322599ffd6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:43.331974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:43.332569 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:43.332849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:43.333121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:43.333742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] RBAC: Adding query filter params (name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:43.334042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:43.335423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:43.341065 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 494/976] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 12 14:29:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:43.346772 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:43.442891 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135988c6-f5f2-4304-8b10-41a3c90f9c72 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:43.475863 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:43.476453 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:43.476733 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:43.477005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:43.477692 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] RBAC: Adding query filter params (interface=public, service_id=7c6e6903c339445c92a2de5eb54070d2, region_id=RegionOne) {{(pid=81562) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:43.477998 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:43.479389 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893418-fb7f-4388-b955-810a292b0c52 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:43.484201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 483/977] 10.222.0.27 () {56 vars in 1251 bytes} [Wed Oct 12 14:29:43 2022] GET /identity/v3/endpoints?service_id=7c6e6903c339445c92a2de5eb54070d2&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:43.489751 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:43.493437 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:43.589830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab834683-eba5-48a1-9e42-ddb27e7228ed None admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:43.627498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:43.628195 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:43.628463 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:43.628781 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:43.629455 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:43.631011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4383ba-6fdf-4900-80fe-1305344e1a00 None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:43.639232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 495/978] 10.222.0.27 () {56 vars in 1087 bytes} [Wed Oct 12 14:29:43 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:29:45.730503 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3768e-36b8-49ae-84af-031535294b23 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:45.731053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3768e-36b8-49ae-84af-031535294b23 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:45.731053 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3768e-36b8-49ae-84af-031535294b23 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:45.732357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 484/979] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:29:45.737437 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:45.737863 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:45.737966 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:45.756376 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:29:45.757560 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:29:45.816718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:45.822879 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 496/980] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:29:45 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 14:29:46.089009 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3768e-36b8-49ae-84af-031535294b23 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:46.109369 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:46.189756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3768e-36b8-49ae-84af-031535294b23 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:46.222612 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:46.223225 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:46.223501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:46.223770 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:46.224347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:46.225700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 14:29:46.234214 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 14:29:46.235372 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application with Lock( Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self._enter() Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application return self.creator() Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application created_value = creator( Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: ERROR keystone.server.flask.application Oct 12 14:29:46.236376 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 485/981] 10.222.0.27 () {56 vars in 1117 bytes} [Wed Oct 12 14:29:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 14:29:46.241186 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:46.334432 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff1ef4-a9c6-44f7-a998-55c27308f1e2 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:46.366583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:46.367169 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:46.367443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:46.367710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] PATH_INFO: `/v3/services` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:46.368317 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:29:46.368613 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:46.369983 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085489da-8dbc-4247-abae-7273b3fcd74f None admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:46.374866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 497/982] 10.222.0.27 () {56 vars in 1116 bytes} [Wed Oct 12 14:29:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:29:46.380262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:29:46.460646 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:46.479138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e045-f8aa-438e-ad58-b2164de11ff1 None admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:29:46.512830 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:29:46.513420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:29:46.513697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:29:46.513968 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:29:46.514654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:29:46.516020 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec3dd0-f842-4c06-af4f-7a627796c2e3 None admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:29:46.534870 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 486/983] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:29:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:29:56.372127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=69 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:29:56.530289 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:49.928066 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acff0-f134-428b-8a25-8ea7289795d7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:49.928565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acff0-f134-428b-8a25-8ea7289795d7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:49.928650 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5acff0-f134-428b-8a25-8ea7289795d7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:49.934221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 498/984] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:30:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:30:49.935834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e24b-94bb-4add-9b0e-60ce9eee537b None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:49.936292 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e24b-94bb-4add-9b0e-60ce9eee537b None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:49.936381 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e24b-94bb-4add-9b0e-60ce9eee537b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:50.074054 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-66f7e24b-94bb-4add-9b0e-60ce9eee537b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:30:50.077057 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-66f7e24b-94bb-4add-9b0e-60ce9eee537b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:50.215133 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 487/985] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:30:50.511456 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:50.511811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:50.512008 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:50.513497 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 499/986] 10.222.0.27 () {54 vars in 964 bytes} [Wed Oct 12 14:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:30:50.519347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca469e7-24a0-4188-98a7-0134ad1c213f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:50.519709 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca469e7-24a0-4188-98a7-0134ad1c213f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:50.520075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca469e7-24a0-4188-98a7-0134ad1c213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:50.602673 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-7ca469e7-24a0-4188-98a7-0134ad1c213f None None] MFA Rules not processed for user `1342faa2ddc741ad9f0f5122041b209b`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:30:50.603954 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7ca469e7-24a0-4188-98a7-0134ad1c213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:50.625140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:50.689046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 488/987] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 12 14:30:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:30:50.698849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:30:50.700622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:50.826007 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc242-5446-4454-b368-60ed26b69d85 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:30:50.911616 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:30:50.912232 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:50.912510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:50.912787 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:50.914423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:50.972940 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:51.038108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:30:51.039621 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0568-2377-40c9-83da-7465a2073730 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:30:51.062400 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 500/988] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:30:53.503462 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:53.504040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:53.504040 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:53.505332 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 489/989] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:30:53.510736 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a95c-6822-4e93-a861-240fcd2219f3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:53.511180 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a95c-6822-4e93-a861-240fcd2219f3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:53.511267 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26a95c-6822-4e93-a861-240fcd2219f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:53.593214 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-ec26a95c-6822-4e93-a861-240fcd2219f3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:30:53.594377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ec26a95c-6822-4e93-a861-240fcd2219f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:53.692746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 501/990] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:30:53.973357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:30:53.974912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:54.079298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205de4f-20c6-4a77-b241-870844d4c623 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:30:54.150384 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:54.153010 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:30:54.153734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:54.154394 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:54.154985 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:54.156927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:54.270916 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:30:54.272297 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe98c3-9a92-460e-9ed8-cf9c1a6500e5 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:30:54.293772 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 490/991] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:30:56.745200 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:56.745734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:56.745734 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:56.747116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 502/992] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:30:56.752393 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6143c95-32a6-4057-80e3-69234ecc2a3d None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:56.752763 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6143c95-32a6-4057-80e3-69234ecc2a3d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:56.752937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6143c95-32a6-4057-80e3-69234ecc2a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:56.817966 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b6143c95-32a6-4057-80e3-69234ecc2a3d None None] MFA Rules not processed for user `1989eb27cf724db5bbe686d58d292980`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:30:56.819204 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b6143c95-32a6-4057-80e3-69234ecc2a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:56.870800 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:56.916144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 491/993] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:30:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:30:57.199953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:30:57.201477 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:57.213685 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:57.305330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fecd9-7bfd-4ba0-a7c4-c174429d9dc5 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:30:57.375934 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:30:57.376563 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:30:57.376836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:30:57.377102 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:30:57.378700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:30:57.440164 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:30:57.486965 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:30:57.488329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb710e-f9fe-4fd5-8015-1879d61b07c3 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:30:57.506804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 503/994] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:30:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:00.149579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:00.150143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:00.150143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:00.151603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 492/995] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:00.156866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d5e1-b589-4bba-8fb7-3fb18f82b21b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:00.157268 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d5e1-b589-4bba-8fb7-3fb18f82b21b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:00.157418 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038d5e1-b589-4bba-8fb7-3fb18f82b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:00.221811 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0038d5e1-b589-4bba-8fb7-3fb18f82b21b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:00.223023 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0038d5e1-b589-4bba-8fb7-3fb18f82b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:00.316614 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 504/996] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:00.602791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:00.604310 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:00.706115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123b75-4524-4080-99d2-6d76c5509465 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:00.777561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:00.778149 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:00.778457 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:00.778724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:00.780289 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:00.787280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:00.886670 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:00.888162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3591cf-bab8-48fa-acff-83caae075e0b service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:00.906075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 493/997] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:03.694663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228507-e11a-4e3c-8556-4da2d67cc711 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:03.695219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228507-e11a-4e3c-8556-4da2d67cc711 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:03.695219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228507-e11a-4e3c-8556-4da2d67cc711 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:03.697079 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 505/998] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:03.702433 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca06be-fa87-499e-90b2-bbf13e8b5a48 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:03.702844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca06be-fa87-499e-90b2-bbf13e8b5a48 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:03.703129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca06be-fa87-499e-90b2-bbf13e8b5a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:03.777374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-daca06be-fa87-499e-90b2-bbf13e8b5a48 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:03.778702 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-daca06be-fa87-499e-90b2-bbf13e8b5a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:03.841458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:03.884314 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 494/999] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:04.181564 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:04.181844 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:04.182111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:04.183480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 506/1000] 10.222.0.27 () {54 vars in 964 bytes} [Wed Oct 12 14:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:04.189211 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0df9-1f9a-4a46-880d-02b19b396559 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:04.189568 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0df9-1f9a-4a46-880d-02b19b396559 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:04.189909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f0df9-1f9a-4a46-880d-02b19b396559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:04.264883 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-418f0df9-1f9a-4a46-880d-02b19b396559 None None] MFA Rules not processed for user `1342faa2ddc741ad9f0f5122041b209b`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:04.265988 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-418f0df9-1f9a-4a46-880d-02b19b396559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:04.341201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 495/1001] 10.222.0.27 () {58 vars in 1061 bytes} [Wed Oct 12 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:04.350234 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:04.351747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:04.372666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:04.455997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d938f1-1881-4073-b60b-b96a142b8c2b None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:04.528414 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:04.528942 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:04.529221 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:04.529490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:04.531082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:04.604167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:04.641849 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:04.643314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87aeef-47bf-4c60-8550-0b54c6021976 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:04.661594 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 507/1002] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:07.095895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:07.096398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:07.096398 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:07.097805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 496/1003] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:07.103395 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc06f9-7ad8-4d57-b080-dbdf532ffd75 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:07.103836 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc06f9-7ad8-4d57-b080-dbdf532ffd75 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:07.103936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc06f9-7ad8-4d57-b080-dbdf532ffd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:07.169377 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a6cc06f9-7ad8-4d57-b080-dbdf532ffd75 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:07.170604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a6cc06f9-7ad8-4d57-b080-dbdf532ffd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:07.265121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 508/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:31:07.543720 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:07.545259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:07.608129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:07.653395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e015-13a7-4cc5-9761-fb8c2444f2b6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:07.728595 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:07.729201 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:07.729475 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:07.729738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:07.731360 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:07.839196 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:07.841896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:07.843732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a121de-70fd-4cc5-8394-175831e08274 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:07.862678 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 497/1005] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:10.078035 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:10.078593 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:10.078687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:10.080002 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 509/1006] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:10.085632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4622e7-58b2-4485-92a7-624168d9460c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:10.086672 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4622e7-58b2-4485-92a7-624168d9460c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:10.086759 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4622e7-58b2-4485-92a7-624168d9460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:10.156674 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-6d4622e7-58b2-4485-92a7-624168d9460c None None] MFA Rules not processed for user `1989eb27cf724db5bbe686d58d292980`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:10.157893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6d4622e7-58b2-4485-92a7-624168d9460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:10.256386 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 498/1007] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:10.537199 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:10.538776 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:10.569587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:10.646262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e0206-2ea7-4939-aede-52a67c974d83 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:10.723330 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:10.723933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:10.724205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:10.724473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:10.726043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:10.807220 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:10.839659 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:10.841282 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8f1ed-e9fd-4cc0-9225-047acc14831f service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:10.859898 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 510/1008] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:13.378275 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:13.378744 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:13.378846 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:13.380172 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 499/1009] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:13.385415 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5f3-ac50-49c8-b863-fc536079d4a3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:13.385868 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5f3-ac50-49c8-b863-fc536079d4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:13.386026 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994f5f3-ac50-49c8-b863-fc536079d4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:13.451437 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-1994f5f3-ac50-49c8-b863-fc536079d4a3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:13.452668 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1994f5f3-ac50-49c8-b863-fc536079d4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:13.546137 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 511/1010] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:13.827731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:13.829327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:13.898787 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:13.932207 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08a846-5d7f-407d-954f-252d62d82bdc None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:14.005300 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:14.005912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:14.006213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:14.006491 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:14.008580 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:14.116259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:14.118282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a48699-d197-4850-b63c-624135554e35 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:14.127979 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:14.136313 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 500/1011] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:16.300851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:16.301365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:16.301365 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:16.302695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 512/1012] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:16.307918 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b299-8d6a-46b7-8d8b-4d4e46233aa2 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:16.308351 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b299-8d6a-46b7-8d8b-4d4e46233aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:16.308466 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8b299-8d6a-46b7-8d8b-4d4e46233aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:16.373587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-60a8b299-8d6a-46b7-8d8b-4d4e46233aa2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:16.374864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-60a8b299-8d6a-46b7-8d8b-4d4e46233aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:16.469755 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 501/1013] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:16.754757 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:16.756341 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:16.796871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:16.859182 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cec03-5852-41e7-b529-1b70d2223f46 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:16.931817 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:16.932419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:16.932693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:16.932955 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:16.934559 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:17.016176 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:17.042508 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:17.043946 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f69dc4-1c3d-49a8-90fa-1e8fc1903a07 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:17.062011 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 513/1014] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:19.657031 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:19.657548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:19.657548 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:19.658850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 502/1015] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:19.664853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896774-31e7-4b9b-8d08-eb144e009ce1 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:19.665280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896774-31e7-4b9b-8d08-eb144e009ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:19.665381 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9896774-31e7-4b9b-8d08-eb144e009ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:19.731219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-b9896774-31e7-4b9b-8d08-eb144e009ce1 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:19.732429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-b9896774-31e7-4b9b-8d08-eb144e009ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:19.829031 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 514/1016] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:31:20.114343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:20.115890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:20.190530 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:20.218684 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6968a-2e61-4777-963c-edc51b4caae8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:20.291425 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:20.291950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:20.292217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:20.292477 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:20.294067 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:20.401311 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:20.402771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce01f2-8a9f-4263-9078-b937013fa2f6 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:20.421007 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 503/1017] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:24.511275 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:24.511773 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:24.511773 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:24.513075 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 515/1018] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:24.518430 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d244-abdc-4e69-a0f8-5161288f268f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:24.518832 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d244-abdc-4e69-a0f8-5161288f268f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:24.519099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d244-abdc-4e69-a0f8-5161288f268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:24.525256 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:24.586321 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-1872d244-abdc-4e69-a0f8-5161288f268f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:24.587326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1872d244-abdc-4e69-a0f8-5161288f268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:24.686772 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 504/1019] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:24.966802 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:24.968324 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:25.018877 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:25.073831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8655e-6613-43be-a2b8-d58b11a68c16 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:25.147705 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:25.148304 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:25.148578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:25.148846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:25.150439 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:25.241161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:25.258118 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:25.259576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34a161-a409-41de-8791-c965661d98c8 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:25.278596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 516/1020] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:28.044731 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:28.045254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:28.045254 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:28.046671 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 505/1021] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:28.052120 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0277-dca6-4083-b1ec-f2cebe1b28d6 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:28.052513 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0277-dca6-4083-b1ec-f2cebe1b28d6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:28.052666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a0277-dca6-4083-b1ec-f2cebe1b28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:28.118900 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-f48a0277-dca6-4083-b1ec-f2cebe1b28d6 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:28.120088 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f48a0277-dca6-4083-b1ec-f2cebe1b28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:28.216328 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 517/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:28.494540 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:28.496086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:28.589432 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:28.614024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95197e-6e0a-4025-88e9-ff25e125b15d None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:28.691534 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:28.692145 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:28.692423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:28.692691 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:28.694305 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:28.801610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:28.803041 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279d670-e2e3-4eba-a0c1-1c3abd3f2862 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:28.821813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 506/1023] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:33.157636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:33.158112 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:33.158226 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:33.159831 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 518/1024] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:33.165950 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3adc-32f0-4a21-8f04-fe85a372ace7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:33.166561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3adc-32f0-4a21-8f04-fe85a372ace7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:33.166561 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3adc-32f0-4a21-8f04-fe85a372ace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:33.182392 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:33.236719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-df7d3adc-32f0-4a21-8f04-fe85a372ace7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:33.237929 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-df7d3adc-32f0-4a21-8f04-fe85a372ace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:33.335959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 507/1025] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:33.621706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:33.623301 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:33.681243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:33.726643 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e6fb-9296-476a-a28d-547bc052f932 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:33.798584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:33.799178 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:33.799453 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:33.799716 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:33.801285 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:33.905569 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:33.909952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:33.911420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9923de-acc6-4346-9367-9f063ff6d336 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:33.929530 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 519/1026] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:38.863027 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f3e-6c9c-4f63-8fd2-7a2a15fa657d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:38.863481 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f3e-6c9c-4f63-8fd2-7a2a15fa657d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:38.863591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff14f3e-6c9c-4f63-8fd2-7a2a15fa657d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:38.865088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 508/1027] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 12 14:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:38.870270 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c9e8-dac6-430f-97fc-ee27f23616be None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:38.870684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c9e8-dac6-430f-97fc-ee27f23616be None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:38.870853 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542c9e8-dac6-430f-97fc-ee27f23616be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:39.002000 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8542c9e8-dac6-430f-97fc-ee27f23616be None None] MFA Rules not processed for user `77caa3ee5f55410084f1d978dca4c749`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:39.003268 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8542c9e8-dac6-430f-97fc-ee27f23616be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:39.132514 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 520/1028] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 12 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:43.333871 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=59 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:43.382075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616fdff-8853-49ff-ad0a-f374f1f5503f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:43.382559 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616fdff-8853-49ff-ad0a-f374f1f5503f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:43.383071 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616fdff-8853-49ff-ad0a-f374f1f5503f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:43.384542 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 509/1029] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 12 14:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:43.390416 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c0e8-5ac7-400e-bfa7-5d1b0002821a None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:43.390911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c0e8-5ac7-400e-bfa7-5d1b0002821a None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:43.390996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23c0e8-5ac7-400e-bfa7-5d1b0002821a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:43.451745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:43.481487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2c23c0e8-5ac7-400e-bfa7-5d1b0002821a None None] MFA Rules not processed for user `77caa3ee5f55410084f1d978dca4c749`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:43.482833 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2c23c0e8-5ac7-400e-bfa7-5d1b0002821a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:43.615636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 521/1030] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 12 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:44.833004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90d06b-f2ea-477d-9e1d-77347fd4b71d None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:44.833627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90d06b-f2ea-477d-9e1d-77347fd4b71d None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:44.833627 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90d06b-f2ea-477d-9e1d-77347fd4b71d None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:44.834903 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 510/1031] 10.222.0.27 () {54 vars in 921 bytes} [Wed Oct 12 14:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:44.839958 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647992-4349-4315-8b1a-e33fa310e610 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:44.840473 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647992-4349-4315-8b1a-e33fa310e610 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:44.840576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32647992-4349-4315-8b1a-e33fa310e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:44.920277 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-32647992-4349-4315-8b1a-e33fa310e610 None None] MFA Rules not processed for user `77caa3ee5f55410084f1d978dca4c749`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:44.921481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-32647992-4349-4315-8b1a-e33fa310e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:44.962936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:45.034866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 522/1032] 10.222.0.27 () {58 vars in 1018 bytes} [Wed Oct 12 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:48.485221 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dee5-5e56-4ca0-8b61-abd5dabd080a None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:48.486247 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dee5-5e56-4ca0-8b61-abd5dabd080a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:48.486747 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dee5-5e56-4ca0-8b61-abd5dabd080a None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:48.489139 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 511/1033] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:48.496467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e50a-576a-4ae4-9b0e-bd03bcd58817 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:48.497413 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e50a-576a-4ae4-9b0e-bd03bcd58817 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:48.497918 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515e50a-576a-4ae4-9b0e-bd03bcd58817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:48.570522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8515e50a-576a-4ae4-9b0e-bd03bcd58817 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:48.571700 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8515e50a-576a-4ae4-9b0e-bd03bcd58817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:48.671926 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 523/1034] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:48.975287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:48.976078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:48.976568 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:48.978374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 512/1035] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 12 14:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:48.989509 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372852-7d15-4ba1-8aac-fd3bd8fe02ad None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:48.990061 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372852-7d15-4ba1-8aac-fd3bd8fe02ad None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:48.992283 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372852-7d15-4ba1-8aac-fd3bd8fe02ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:49.014034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:49.077654 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-3a372852-7d15-4ba1-8aac-fd3bd8fe02ad None None] MFA Rules not processed for user `4ae307c1cb064d0cb4b8b61cc5fe13d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:49.083070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-3a372852-7d15-4ba1-8aac-fd3bd8fe02ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:49.225069 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 524/1036] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:49.225681 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:49.227460 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:49.392624 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9a522-1ca1-4a60-af2d-66ecdae37afe None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:49.469717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:49.512018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:49.512632 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:49.512844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:49.513089 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:49.514763 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:49.620506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:49.622088 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f58fb0-543f-48b1-9451-618a30b3424c service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:49.641326 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 513/1037] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 14:31:52.015370 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:52.015882 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:52.015882 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:52.017274 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 525/1038] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:52.023365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a24c-1954-4d29-95b1-423da8d9d1b5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:52.023774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a24c-1954-4d29-95b1-423da8d9d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:52.024038 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99a24c-1954-4d29-95b1-423da8d9d1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:52.099663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5f99a24c-1954-4d29-95b1-423da8d9d1b5 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:52.100937 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5f99a24c-1954-4d29-95b1-423da8d9d1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:52.140571 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:52.204666 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 514/1039] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:52.491815 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:52.493319 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:52.568336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:52.668584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d71e9-07e1-4c6e-ac84-c721a154c4f0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:52.812472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:52.813084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:52.813357 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:52.813622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:52.815230 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:52.840901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:52.913320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:52.914881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8ecf4-4cc3-4a4e-8a01-56db4d4ef056 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:52.933329 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 526/1040] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:55.387152 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0efa-fb82-4b52-8785-6dec997ee161 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:55.387570 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0efa-fb82-4b52-8785-6dec997ee161 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:55.387736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d0efa-fb82-4b52-8785-6dec997ee161 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:55.392850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 515/1041] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:55.394813 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d833a-f668-4ad8-a2aa-0b3b34805412 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:55.395242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d833a-f668-4ad8-a2aa-0b3b34805412 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:55.395547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d833a-f668-4ad8-a2aa-0b3b34805412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:55.465681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-d75d833a-f668-4ad8-a2aa-0b3b34805412 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:55.467105 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d75d833a-f668-4ad8-a2aa-0b3b34805412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:55.565670 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:55.574219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 527/1042] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:55.860042 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:55.860473 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:55.860847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:55.863291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 516/1043] 10.222.0.27 () {54 vars in 961 bytes} [Wed Oct 12 14:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:55.869055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5997-c0a5-4f11-855c-e9d523567711 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:55.869358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5997-c0a5-4f11-855c-e9d523567711 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:55.869599 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5997-c0a5-4f11-855c-e9d523567711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:55.947976 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-081c5997-c0a5-4f11-855c-e9d523567711 None None] MFA Rules not processed for user `4ae307c1cb064d0cb4b8b61cc5fe13d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:55.949165 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-081c5997-c0a5-4f11-855c-e9d523567711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:56.071139 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 528/1044] 10.222.0.27 () {58 vars in 1058 bytes} [Wed Oct 12 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:31:56.079208 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:56.080865 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:56.233066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586e125-2968-44f4-a710-34662f2196c6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:56.255140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:56.354650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:56.355282 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:56.355567 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:56.355827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:56.357401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:56.452666 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:56.454291 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776eff4-4f0f-4d6f-b199-f286aaf7abc9 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:56.474736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 517/1045] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:56.640683 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb42-af4b-4174-ae31-860d1b1d3587 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:56.641263 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb42-af4b-4174-ae31-860d1b1d3587 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:56.641263 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809bb42-af4b-4174-ae31-860d1b1d3587 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:56.642937 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 529/1046] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:31:56.648652 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceaf5e-63fd-4088-9c41-b9198c73a47c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:56.648982 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceaf5e-63fd-4088-9c41-b9198c73a47c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:56.649198 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceaf5e-63fd-4088-9c41-b9198c73a47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:56.687845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:56.733220 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-57ceaf5e-63fd-4088-9c41-b9198c73a47c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:56.734673 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-57ceaf5e-63fd-4088-9c41-b9198c73a47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:56.853267 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 518/1047] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:57.187571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:57.187851 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:57.188121 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:57.190010 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 530/1048] 10.222.0.27 () {54 vars in 963 bytes} [Wed Oct 12 14:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:57.195213 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed7be-6a57-459e-a234-4a73a12c854c None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:57.195495 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed7be-6a57-459e-a234-4a73a12c854c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:57.195767 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed7be-6a57-459e-a234-4a73a12c854c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:57.274519 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-4a0ed7be-6a57-459e-a234-4a73a12c854c None None] MFA Rules not processed for user `fd11abedcea148cd863b25261a0b37e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:57.275878 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4a0ed7be-6a57-459e-a234-4a73a12c854c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:57.325751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:57.357886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 519/1049] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 12 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:57.366441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:57.367973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:57.420622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:57.479997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7ba6e-17b5-473a-a140-2ff026253de7 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:57.560856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd11abedcea148cd863b25261a0b37e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:57.561459 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:57.561743 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:57.561992 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:57.563625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:57.680714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:57.696649 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:57.698420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc5819-7edf-453c-8e32-72383e1c3f07 service cinder] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:57.722814 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 531/1050] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:31:58.722005 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04742-f293-425c-8755-b2229adff88e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:58.722603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04742-f293-425c-8755-b2229adff88e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:58.722603 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af04742-f293-425c-8755-b2229adff88e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:58.723949 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 520/1051] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:31:58.729565 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b0ab-ce72-479c-b792-fc8f1c628b8b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:58.729998 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b0ab-ce72-479c-b792-fc8f1c628b8b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:58.730252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2b0ab-ce72-479c-b792-fc8f1c628b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:58.795804 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-58f2b0ab-ce72-479c-b792-fc8f1c628b8b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:31:58.796994 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-58f2b0ab-ce72-479c-b792-fc8f1c628b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:58.894082 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 532/1052] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:31:59.188243 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af04742-f293-425c-8755-b2229adff88e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:31:59.189814 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1af04742-f293-425c-8755-b2229adff88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:59.346995 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af04742-f293-425c-8755-b2229adff88e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:31:59.400152 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:31:59.464502 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:31:59.465142 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:31:59.465420 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:31:59.465691 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:31:59.467459 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:31:59.562738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:31:59.564710 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cb13a-219a-4d7c-812b-af99bf9ada9e service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:31:59.583173 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 521/1053] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:01.822687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:01.823207 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:01.823207 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:01.824557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 533/1054] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:01.829924 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca155-0ce5-4e8b-a8b1-342b0372c7b5 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:01.830927 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca155-0ce5-4e8b-a8b1-342b0372c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:01.831022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ca155-0ce5-4e8b-a8b1-342b0372c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:01.900953 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e95ca155-0ce5-4e8b-a8b1-342b0372c7b5 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:01.902143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e95ca155-0ce5-4e8b-a8b1-342b0372c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:01.910738 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:02.016877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 522/1055] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:02.307013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:02.309250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:02.373696 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:02.463536 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9569a1d-59dd-410e-bf0c-797874ca7f0d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:02.583493 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:02.584015 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:02.584290 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:02.584558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:02.586124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:02.607830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:02.685911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:02.687567 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8433c-7e38-4c2b-a9bc-98d020a4fdf4 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:02.706480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 534/1056] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:04.902923 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:04.903470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:04.903470 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:04.904932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 523/1057] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:04.910342 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1cd6-8024-400a-b08d-5f66f082125b None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:04.910780 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1cd6-8024-400a-b08d-5f66f082125b None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:04.910870 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac1cd6-8024-400a-b08d-5f66f082125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:04.978374 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-40ac1cd6-8024-400a-b08d-5f66f082125b None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:04.979547 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-40ac1cd6-8024-400a-b08d-5f66f082125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:05.093589 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:05.114298 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 535/1058] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:05.403339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:05.404783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:05.547106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:05.561396 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305a2df-c1f7-4d82-8ac7-f8c27e65b6d5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:05.703691 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:05.704296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:05.704615 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:05.704932 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:05.706751 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:05.799813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:05.801444 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c1655-3bc8-40aa-acde-19614ee5b11a service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:05.811676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:05.820786 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 524/1059] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 14:32:08.038425 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:08.038944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:08.038944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:08.040215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 536/1060] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:08.045538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9387-ac6d-492a-9fac-796d2651975a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:08.045976 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9387-ac6d-492a-9fac-796d2651975a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:08.046086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9387-ac6d-492a-9fac-796d2651975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:08.132693 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c1de9387-ac6d-492a-9fac-796d2651975a None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:08.134454 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c1de9387-ac6d-492a-9fac-796d2651975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:08.244893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 525/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:08.536697 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:08.539056 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:08.716647 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45a7f6-81af-47cd-8377-eb65a83e06f0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:08.793053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:08.853020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:08.853632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:08.853948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:08.854193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:08.855775 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:08.955431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:08.957042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f649b56-700a-40c3-9233-b487eeea0635 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:08.975973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 537/1062] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:11.517251 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:11.517790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:11.517955 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:11.519732 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 526/1063] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:11.526159 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d67f-14ac-4490-b6b5-a7e85e351492 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:11.526636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d67f-14ac-4490-b6b5-a7e85e351492 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:11.526878 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d67f-14ac-4490-b6b5-a7e85e351492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:11.606952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-2210d67f-14ac-4490-b6b5-a7e85e351492 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:11.608382 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2210d67f-14ac-4490-b6b5-a7e85e351492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:11.645542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:11.720428 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 538/1064] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:12.012231 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:12.013774 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:12.105018 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:12.180079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a4dd0-fbbc-4f94-a165-f6e77731af49 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:12.300670 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:12.301589 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:12.302076 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:12.302573 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:12.304363 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:12.349240 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:12.409994 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:12.412347 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61a2dc-a6e2-44dd-89e1-89c21a571bc6 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:12.430455 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 527/1065] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:13.352880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9dd09-e72a-4934-869d-5b4945b76921 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:13.353378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9dd09-e72a-4934-869d-5b4945b76921 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:13.353378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9dd09-e72a-4934-869d-5b4945b76921 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:13.356233 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 539/1066] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:13.362674 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa708-f7e5-4418-89ed-f6fa8b6f82a6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:13.363227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa708-f7e5-4418-89ed-f6fa8b6f82a6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:13.363227 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa708-f7e5-4418-89ed-f6fa8b6f82a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:13.436236 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-c60fa708-f7e5-4418-89ed-f6fa8b6f82a6 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:13.437434 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c60fa708-f7e5-4418-89ed-f6fa8b6f82a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:13.542835 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 528/1067] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:13.851587 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:13.851978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:13.852281 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:13.853873 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 540/1068] 10.222.0.27 () {54 vars in 962 bytes} [Wed Oct 12 14:32:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:13.859000 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a81f-4e5d-44b8-94a1-d63bf1f5c2f3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:13.859288 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a81f-4e5d-44b8-94a1-d63bf1f5c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:13.859584 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18a81f-4e5d-44b8-94a1-d63bf1f5c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:13.879790 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:13.957248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-fb18a81f-4e5d-44b8-94a1-d63bf1f5c2f3 None None] MFA Rules not processed for user `9cd9f8c45f0743579418354966a74ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:13.958483 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fb18a81f-4e5d-44b8-94a1-d63bf1f5c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:14.050296 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 529/1069] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Oct 12 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:14.060219 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:14.062378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:14.185901 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50c14c-07d0-46ff-a9bd-41add05d8b36 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:14.261932 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:14.278440 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd9f8c45f0743579418354966a74ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:14.279060 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:14.279339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:14.279614 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:14.281451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:14.401103 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:14.402718 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb0007-aa7c-427f-a007-2d7df402867d service glance] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:14.423054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 541/1070] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 14:32:14.659622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a9b2-0a0d-46e4-a6bc-14fb7130c332 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:14.660258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a9b2-0a0d-46e4-a6bc-14fb7130c332 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:14.660258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7a9b2-0a0d-46e4-a6bc-14fb7130c332 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:14.661516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 530/1071] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:14.668384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:14.668755 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:14.669094 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:14.763162 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:14.764643 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:14.820826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:14.893449 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 542/1072] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:15.220026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383c23-24e3-423a-a550-52ec157cc82a None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:15.220332 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383c23-24e3-423a-a550-52ec157cc82a None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:15.220610 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383c23-24e3-423a-a550-52ec157cc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:15.233386 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:15.234611 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:15.311343 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-b3383c23-24e3-423a-a550-52ec157cc82a None None] MFA Rules not processed for user `819d82f467814fe79b103bf663e86ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:15.313717 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b3383c23-24e3-423a-a550-52ec157cc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:15.366699 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964a090-8351-4355-a2a8-1af4574e8d3c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:15.409948 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:15.447270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 531/1073] 10.222.0.27 () {58 vars in 1009 bytes} [Wed Oct 12 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:15.450903 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:15.495051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3878bb-c4aa-4adc-b572-a48a89b8d67e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:15.495335 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3878bb-c4aa-4adc-b572-a48a89b8d67e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:15.495628 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3878bb-c4aa-4adc-b572-a48a89b8d67e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:15.497080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 532/1074] 10.222.0.27 () {54 vars in 943 bytes} [Wed Oct 12 14:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 14:32:15.504122 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7112-e839-4159-9916-7b2fdf40964e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:15.504896 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7112-e839-4159-9916-7b2fdf40964e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:15.505177 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea7112-e839-4159-9916-7b2fdf40964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:15.524978 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:15.525576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:15.525852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:15.526116 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:15.527727 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:15.591958 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d6ea7112-e839-4159-9916-7b2fdf40964e None None] MFA Rules not processed for user `4beca14124924c829fd429cef16bd5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:15.593497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d6ea7112-e839-4159-9916-7b2fdf40964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:15.634408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:15.636027 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:15.660249 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 543/1075] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:15.735920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:15.737167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:15.738368 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 533/1076] 10.222.0.27 () {58 vars in 1040 bytes} [Wed Oct 12 14:32:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:32:15.815380 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:15.846408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c8e4f-e4b0-4782-8d4d-69fd00090a8a service nova] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:15.972464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4beca14124924c829fd429cef16bd5d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:15.973170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:15.973487 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:15.973784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:15.975687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:16.069476 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:16.071467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dee4e-f4f2-4c99-b8c5-b0b7a3eecc2d service swift] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:16.081399 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 544/1077] 10.222.0.27 () {60 vars in 1384 bytes} [Wed Oct 12 14:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 14:32:17.885848 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:17.886464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:17.886464 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:17.888048 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 534/1078] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:17.893170 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedadc1-1f3a-49a4-8a11-5edf884699cf None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:17.893604 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedadc1-1f3a-49a4-8a11-5edf884699cf None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:17.893800 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedadc1-1f3a-49a4-8a11-5edf884699cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:17.909369 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:17.964146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-dfedadc1-1f3a-49a4-8a11-5edf884699cf None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:17.965358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dfedadc1-1f3a-49a4-8a11-5edf884699cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:18.085953 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 545/1079] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:18.377783 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:18.379339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:18.413270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:18.543456 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4019-e0b7-48df-9cde-c093aefb36ea None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:18.657022 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:18.673244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:18.673862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:18.674298 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:18.674569 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:18.676187 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:18.781874 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:18.783516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a223843-8ae8-4088-a68a-873880b57bb2 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:18.802276 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 535/1080] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:21.020406 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:21.020917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:21.020917 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:21.022303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 546/1081] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:21.027891 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd0dc-c803-4f05-9821-4215da8c82e6 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:21.028388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd0dc-c803-4f05-9821-4215da8c82e6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:21.028482 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd0dc-c803-4f05-9821-4215da8c82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:21.098567 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d50cd0dc-c803-4f05-9821-4215da8c82e6 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:21.099804 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d50cd0dc-c803-4f05-9821-4215da8c82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:21.181656 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:21.226224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 536/1082] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:21.537930 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:21.539501 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:21.644084 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:21.713028 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481ca5b-d5ab-4fe3-bba5-cb0ca29eb0e0 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:21.844641 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:21.845250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:21.845524 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:21.845792 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:21.847483 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:21.913281 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:21.951429 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:21.953653 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bfb22-e88b-44d5-aab1-d5362f68cb88 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:21.973818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 547/1083] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:24.276423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:24.276984 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:24.276984 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:24.278557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 537/1084] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:24.284576 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b56ab-7807-4eac-b1ed-542bfba71a00 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:24.284996 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b56ab-7807-4eac-b1ed-542bfba71a00 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:24.285168 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b56ab-7807-4eac-b1ed-542bfba71a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:24.360782 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-cf3b56ab-7807-4eac-b1ed-542bfba71a00 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:24.362361 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-cf3b56ab-7807-4eac-b1ed-542bfba71a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:24.474750 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 548/1085] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:24.767616 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:24.769140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:24.934657 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae877e-ef20-4a50-a7fd-8036f25254f5 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:24.987713 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:25.062383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:25.062998 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:25.063281 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:25.063557 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:25.065259 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:25.163280 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:25.164997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d719d-4334-41fc-94ce-5cd60acb5b7b service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:25.183246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 538/1086] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:34.473161 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=87 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:35.181134 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=76 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:38.697338 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937332-4ef8-4f01-bf38-b4dabdb2f9d0 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:38.697911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937332-4ef8-4f01-bf38-b4dabdb2f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:38.697911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58937332-4ef8-4f01-bf38-b4dabdb2f9d0 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:38.699281 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 549/1087] 10.222.0.27 () {54 vars in 918 bytes} [Wed Oct 12 14:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:38.704348 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dacc0-6ebc-4a2b-b483-73d34c4123b1 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:38.704778 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dacc0-6ebc-4a2b-b483-73d34c4123b1 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:38.704882 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dacc0-6ebc-4a2b-b483-73d34c4123b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:38.780647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-972dacc0-6ebc-4a2b-b483-73d34c4123b1 None None] MFA Rules not processed for user `77caa3ee5f55410084f1d978dca4c749`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:38.781829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-972dacc0-6ebc-4a2b-b483-73d34c4123b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:38.886777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 539/1088] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:38.901120 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539ab-fd85-4376-9d09-10e69a08bbc9 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:38.901408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539ab-fd85-4376-9d09-10e69a08bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:38.901684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f539ab-fd85-4376-9d09-10e69a08bbc9 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:38.903075 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 550/1089] 10.222.0.27 () {54 vars in 918 bytes} [Wed Oct 12 14:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:38.908739 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df3ed-5737-49d3-b010-0b53d1f5d446 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:38.909024 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df3ed-5737-49d3-b010-0b53d1f5d446 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:38.909299 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644df3ed-5737-49d3-b010-0b53d1f5d446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:38.981339 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:38.985268 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-644df3ed-5737-49d3-b010-0b53d1f5d446 None None] MFA Rules not processed for user `4ae307c1cb064d0cb4b8b61cc5fe13d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:38.987034 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-644df3ed-5737-49d3-b010-0b53d1f5d446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:39.103564 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 540/1090] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Oct 12 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:41.648584 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:41.649148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:41.649148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:41.650480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 551/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:41.656485 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bff4-b116-4f97-95a1-05d26540e1e8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:41.656924 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bff4-b116-4f97-95a1-05d26540e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:41.657031 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2bff4-b116-4f97-95a1-05d26540e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:41.723164 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-5ce2bff4-b116-4f97-95a1-05d26540e1e8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:41.724375 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5ce2bff4-b116-4f97-95a1-05d26540e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:41.777814 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:41.820957 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 541/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:32:42.110195 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:42.111714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:42.255767 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969abeff-dfe8-496c-8f6a-08ac6cfccbfe None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:42.327656 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:42.367744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:42.368347 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:42.368622 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:42.368893 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:42.370505 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:42.458378 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:42.459972 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ef326-4480-4ac4-b36d-128c085b4f89 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:42.478038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 552/1093] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:43.607239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:43.607797 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:43.607797 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:43.609109 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 542/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:43.615318 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87772a0-56c5-4943-97c2-f86f12f6e30d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:43.615784 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87772a0-56c5-4943-97c2-f86f12f6e30d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:43.615881 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87772a0-56c5-4943-97c2-f86f12f6e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:43.691183 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-c87772a0-56c5-4943-97c2-f86f12f6e30d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:43.692366 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c87772a0-56c5-4943-97c2-f86f12f6e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:43.718062 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:43.786972 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 553/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:43.937038 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:43.938605 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:44.083057 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070ba4c-7ba4-4f67-9a9b-a364e7a5f69f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:44.122886 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:44.194686 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:44.195312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:44.195587 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:44.195854 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:44.197423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:44.286827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:44.288350 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c1ce2-098b-4fd4-b801-83135f3e9dd9 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:44.305827 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 543/1096] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:45.423240 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:45.423636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:45.423894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:45.425120 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 554/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:45.431308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9776-0dda-4e11-b773-2ddef0043446 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:45.431724 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9776-0dda-4e11-b773-2ddef0043446 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:45.431853 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed9776-0dda-4e11-b773-2ddef0043446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:45.486334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:45.508323 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0bed9776-0dda-4e11-b773-2ddef0043446 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:45.509531 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0bed9776-0dda-4e11-b773-2ddef0043446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:45.604852 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 544/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:45.754507 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:45.756025 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:45.900574 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a1f274-0371-4388-a310-4d9cf141db5d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:45.913013 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:46.011362 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:46.011968 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:46.012243 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:46.012510 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:46.014087 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:46.101488 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:46.103078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f115426-e323-40f1-8da8-f118279386e8 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:46.120250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 555/1099] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:47.232885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:47.233445 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:47.233445 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:47.235388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 545/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:47.241558 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc037-c5ff-411f-8336-d819d079521f None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:47.241993 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc037-c5ff-411f-8336-d819d079521f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:47.242086 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfc037-c5ff-411f-8336-d819d079521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:47.262944 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:47.320158 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4dcfc037-c5ff-411f-8336-d819d079521f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:47.321356 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4dcfc037-c5ff-411f-8336-d819d079521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:47.416124 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 556/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:47.565677 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:47.567170 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:47.676598 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:47.712818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536395f-57f6-4a43-ac6b-a3f3b35036b6 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:47.823697 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:47.824228 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:47.824506 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:47.824777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:47.826395 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:47.901946 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:47.915939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:47.917528 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898855ac-3e60-4ab8-82a8-ee1e24871634 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:47.935478 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 546/1102] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:49.029258 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372f66-edb3-4849-838c-0febce6530af None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:49.029742 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372f66-edb3-4849-838c-0febce6530af None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:49.029837 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff372f66-edb3-4849-838c-0febce6530af None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:49.031235 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 557/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:49.037845 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead5e-a0be-49f1-a942-6d26c6cb3f11 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:49.038287 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead5e-a0be-49f1-a942-6d26c6cb3f11 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:49.038424 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ead5e-a0be-49f1-a942-6d26c6cb3f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:49.114890 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-570ead5e-a0be-49f1-a942-6d26c6cb3f11 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:49.116086 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-570ead5e-a0be-49f1-a942-6d26c6cb3f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:49.212338 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 547/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:49.364889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372f66-edb3-4849-838c-0febce6530af None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:49.366359 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ff372f66-edb3-4849-838c-0febce6530af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:49.449636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:49.509997 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff372f66-edb3-4849-838c-0febce6530af None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:49.619681 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:49.620205 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:49.620481 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:49.620747 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:49.622344 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:49.669936 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:49.709571 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:49.711193 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb06d13-8f36-4652-8dcc-974adf7905d8 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:49.729010 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 558/1105] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:50.779353 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:50.779900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:50.779900 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:50.781246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 548/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:50.787826 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544990-ea41-4376-a8e7-31f635a6be80 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:50.788271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544990-ea41-4376-a8e7-31f635a6be80 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:50.788470 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544990-ea41-4376-a8e7-31f635a6be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:50.863246 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-a1544990-ea41-4376-a8e7-31f635a6be80 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:50.864445 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a1544990-ea41-4376-a8e7-31f635a6be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:50.958250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 559/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:51.108257 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:51.109680 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:51.158239 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:51.255493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a8781-6004-4aeb-88a1-00f275ac9b97 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:51.366654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:51.367185 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:51.367463 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:51.367734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:51.369324 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:51.376711 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:51.458957 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:51.460555 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7608d9-066f-489e-a93e-cd64a61e42a5 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:51.482106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 549/1108] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:52.525504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:52.526090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:52.526090 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:52.527418 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 560/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:52.534123 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de21df-696d-4715-af92-1e880b04b03f None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:52.534663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de21df-696d-4715-af92-1e880b04b03f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:52.534841 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de21df-696d-4715-af92-1e880b04b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:52.608661 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-54de21df-696d-4715-af92-1e880b04b03f None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:52.609850 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-54de21df-696d-4715-af92-1e880b04b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:52.676765 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:52.705383 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 550/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:32:52.855354 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:52.856788 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:52.874326 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:53.000529 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd50a70-0bed-4f97-a965-72ed0f94ff7f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:53.087791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:53.112920 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:53.113467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:53.113744 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:53.114014 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:53.115619 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:53.205101 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:53.206820 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1463171-c7b9-473b-a070-9fad01888d09 service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:53.224271 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 561/1111] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:54.269512 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:54.270045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:54.270045 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:54.271334 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 551/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:54.277504 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cecf4-a5a7-441f-a682-721f4d6b90a8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:54.277952 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cecf4-a5a7-441f-a682-721f4d6b90a8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:54.278083 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cecf4-a5a7-441f-a682-721f4d6b90a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:54.353810 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-8b3cecf4-a5a7-441f-a682-721f4d6b90a8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:54.355034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-8b3cecf4-a5a7-441f-a682-721f4d6b90a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:54.397111 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:54.450130 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 562/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:54.599423 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:54.600862 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:54.747803 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89445000-8cc7-43be-8856-b6477f71cba2 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:54.801536 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:54.859825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:54.860350 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:54.860622 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:54.860889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:54.862521 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:54.951274 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:54.952864 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41312949-838c-4e83-be62-16843f48ac47 service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:54.970768 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 552/1114] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:56.017334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:56.017794 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:56.017891 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:56.019947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 563/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 14:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:56.026143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89730-1fcd-41db-8f96-1d070b10ae89 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:56.026621 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89730-1fcd-41db-8f96-1d070b10ae89 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:56.026715 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce89730-1fcd-41db-8f96-1d070b10ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:56.100909 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-bce89730-1fcd-41db-8f96-1d070b10ae89 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:56.102097 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bce89730-1fcd-41db-8f96-1d070b10ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:56.104115 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:56.198828 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 553/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:56.349866 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:56.351373 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:56.494907 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f11ce7-c940-4e1e-ae49-f30356754004 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:56.521431 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:56.608640 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:56.609167 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:56.609441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:56.609708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:56.611336 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:56.699096 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:56.700666 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a241a-21b1-4563-9ef5-b8891c6efb2d service nova] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:56.717759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 564/1117] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:32:58.786057 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:58.786754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:58.786754 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:58.787971 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 554/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:32:58.793254 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff316-c1f5-437d-bb60-7f125c0ac543 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:58.793694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff316-c1f5-437d-bb60-7f125c0ac543 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:58.793817 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacff316-c1f5-437d-bb60-7f125c0ac543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:58.834694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:58.859908 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-dacff316-c1f5-437d-bb60-7f125c0ac543 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:32:58.861108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-dacff316-c1f5-437d-bb60-7f125c0ac543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:58.955969 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 565/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:32:59.245844 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:32:59.247427 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:59.350496 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbfb7c-c949-4a34-aec2-61cdbba2f229 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:32:59.382417 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:32:59.425513 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:32:59.426114 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:32:59.426435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:32:59.426704 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:32:59.428746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:32:59.537997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:32:59.539435 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcf56c-1277-4e08-a018-bd66002e463d service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:32:59.557055 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 555/1120] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:01.856578 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:01.857142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:01.857142 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:01.858516 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 566/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:01.864629 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb8eb-f618-4f89-9122-ad47b60c76e7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:01.865122 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb8eb-f618-4f89-9122-ad47b60c76e7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:01.865230 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bb8eb-f618-4f89-9122-ad47b60c76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:01.935174 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9e9bb8eb-f618-4f89-9122-ad47b60c76e7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:01.936388 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9e9bb8eb-f618-4f89-9122-ad47b60c76e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:01.949306 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:02.034321 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 556/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 14:33:02.318729 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:02.320245 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:02.423713 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f2680-a3df-4960-9792-e0deac042395 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:02.436427 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:02.499099 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:02.499708 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:02.499987 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:02.500259 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:02.501846 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:02.609719 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:02.611109 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c753e18-3648-470e-9cdf-c29b9bfe54ae service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:02.628879 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 567/1123] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:05.065959 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:05.066525 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:05.066525 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:05.067856 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 557/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:05.073071 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba11904-c156-4be5-806d-6759a9665e13 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:05.073500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba11904-c156-4be5-806d-6759a9665e13 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:05.073632 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba11904-c156-4be5-806d-6759a9665e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:05.121714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:05.139490 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6ba11904-c156-4be5-806d-6759a9665e13 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:05.140697 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6ba11904-c156-4be5-806d-6759a9665e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:05.235690 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 568/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:05.516880 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:05.518454 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:05.622829 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cf0ec-6ad5-4c93-8719-3b4b7d55a96c None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:05.663066 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:05.697082 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:05.697640 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:05.697923 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:05.698218 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:05.699805 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:05.808238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:05.809668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a33f48-d90a-4aa6-a2fa-65761381733a service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:05.827178 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 558/1126] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:08.063420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:08.063947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:08.063947 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:08.065348 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 569/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:08.071188 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4648-4ba6-4c11-b254-b62d597d5278 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:08.071609 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4648-4ba6-4c11-b254-b62d597d5278 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:08.071729 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c4648-4ba6-4c11-b254-b62d597d5278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:08.138051 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-d60c4648-4ba6-4c11-b254-b62d597d5278 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:08.139277 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-d60c4648-4ba6-4c11-b254-b62d597d5278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:08.160484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:08.236378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 559/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:08.525204 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:08.526762 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:08.629746 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62822d1f-b466-4a47-9d5e-8a175773663c None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:08.649933 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:08.702875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:08.703482 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:08.703758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:08.704029 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:08.705607 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:08.811948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:08.813296 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582669-6b05-486d-97e0-59a284b5e490 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:08.830745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 570/1129] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:11.057119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:11.057644 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:11.057644 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:11.059078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 560/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:11.064412 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c526df-32aa-49b0-a1c9-025267295352 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:11.064850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c526df-32aa-49b0-a1c9-025267295352 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:11.064948 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c526df-32aa-49b0-a1c9-025267295352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:11.128770 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:11.132420 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-05c526df-32aa-49b0-a1c9-025267295352 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:11.133974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-05c526df-32aa-49b0-a1c9-025267295352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:11.229830 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 571/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:11.519364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:11.520882 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:11.624664 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd377df-3b76-468d-bed9-a5d6b11c624f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:11.674229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:11.698901 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:11.699439 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:11.699719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:11.699989 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:11.701579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:11.810126 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:11.811575 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71c8c-fc4e-4980-8196-76c45e519643 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:11.829942 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 561/1132] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:14.023542 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:14.024028 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:14.024132 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:14.025438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 572/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:14.030734 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081ca2f-5105-47c3-bc6d-03c64b4c98c3 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:14.031162 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081ca2f-5105-47c3-bc6d-03c64b4c98c3 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:14.031289 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081ca2f-5105-47c3-bc6d-03c64b4c98c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:14.097480 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-0081ca2f-5105-47c3-bc6d-03c64b4c98c3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:14.098742 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-0081ca2f-5105-47c3-bc6d-03c64b4c98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:14.127141 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:14.195358 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 562/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:14.482636 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:14.484173 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:14.586250 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dcaf57-80cd-4f18-8022-b5ddb2515e22 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:14.616974 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:14.663106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:14.663714 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:14.663991 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:14.664262 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:14.665850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:14.773935 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:14.775341 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab62e-1356-46cb-8784-7ca34b954613 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:14.793871 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 573/1135] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:16.982301 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:16.982877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:16.982877 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:16.984244 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 563/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:16.990315 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace5b2-8a2c-4d83-89b9-cf420a067eb3 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:16.990758 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace5b2-8a2c-4d83-89b9-cf420a067eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:16.990854 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ace5b2-8a2c-4d83-89b9-cf420a067eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:17.056773 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-75ace5b2-8a2c-4d83-89b9-cf420a067eb3 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:17.057957 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-75ace5b2-8a2c-4d83-89b9-cf420a067eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:17.066016 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:17.151320 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 574/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:17.434321 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:17.435839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:17.537354 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22e817-1ada-4ffa-a8be-af53b8b877ed None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:17.592583 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:17.611236 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:17.611839 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:17.612112 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:17.612378 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:17.614598 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:17.721819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:17.723818 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d65da-1840-4114-86a8-ac5cdb1bd759 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:17.742194 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 564/1138] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:19.936644 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:19.937206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:19.937206 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:19.938557 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:19.943842 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca27f-7273-4177-ab8f-303d624e8d9e None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:19.944305 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca27f-7273-4177-ab8f-303d624e8d9e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:19.944402 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ca27f-7273-4177-ab8f-303d624e8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:20.010093 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9a8ca27f-7273-4177-ab8f-303d624e8d9e None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:20.011327 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9a8ca27f-7273-4177-ab8f-303d624e8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:20.049117 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:20.107821 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:20.396658 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:20.398213 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:20.501764 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e2e9-cfe1-4682-902c-bc9b62bcbd4e None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:20.539252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:20.575404 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:20.576005 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:20.576280 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:20.576546 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:20.578115 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:20.684818 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:20.686276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef1657-2fff-4c7b-b8c8-c8988f39b5e4 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:20.704038 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 576/1141] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:22.869654 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:22.870247 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:22.870247 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:22.871586 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:22.876834 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc4454-4be4-4af1-a8f8-11f660b2cb08 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:22.877242 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc4454-4be4-4af1-a8f8-11f660b2cb08 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:22.877371 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc4454-4be4-4af1-a8f8-11f660b2cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:22.943371 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-6fdc4454-4be4-4af1-a8f8-11f660b2cb08 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:22.944551 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-6fdc4454-4be4-4af1-a8f8-11f660b2cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:22.962054 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:23.042073 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:23.327885 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:23.329429 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:23.432286 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb375-70b9-4ff7-b11b-3c9a2e43371e None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:23.498579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:23.505336 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:23.505935 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:23.506235 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:23.506508 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:23.508095 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:23.616571 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:23.617933 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c77214-9a7e-4327-9b5b-e5428727bae1 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:23.636798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 567/1144] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:25.860962 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:25.861606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:25.861606 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:25.862824 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 14:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:25.868668 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dfada-48d9-44c8-bb0b-ad4576678612 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:25.869106 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dfada-48d9-44c8-bb0b-ad4576678612 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:25.869220 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53dfada-48d9-44c8-bb0b-ad4576678612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:25.934155 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-e53dfada-48d9-44c8-bb0b-ad4576678612 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:25.935374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e53dfada-48d9-44c8-bb0b-ad4576678612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:25.982290 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:26.030813 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:26.312583 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:26.314143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:26.416786 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f01eba-d088-4b99-9bfa-38a5b0ab6ec1 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:26.462984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:26.489438 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:26.490042 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:26.490355 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:26.490625 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:26.492198 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:26.600175 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:26.601533 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0c372-2448-47ff-92cd-71063989e8e4 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:26.619759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 579/1147] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:36.029262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=22 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:36.617441 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=66 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:46.435406 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4151-e071-475c-964b-d407ad6ae7b5 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:46.435951 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4151-e071-475c-964b-d407ad6ae7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:46.435951 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be4151-e071-475c-964b-d407ad6ae7b5 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:46.437308 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 569/1148] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:46.442720 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cdbd-9887-49be-ac94-024ed1dc3ee8 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:46.443276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cdbd-9887-49be-ac94-024ed1dc3ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:46.443276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4cdbd-9887-49be-ac94-024ed1dc3ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:46.508012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-eab4cdbd-9887-49be-ac94-024ed1dc3ee8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:46.509215 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-eab4cdbd-9887-49be-ac94-024ed1dc3ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:46.604663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 580/1149] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:46.907357 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:46.907650 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:46.907926 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:46.909258 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 570/1150] 10.222.0.27 () {54 vars in 962 bytes} [Wed Oct 12 14:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:46.915276 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718ba1-2eb0-4278-a4dc-a09a0ac87c51 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:46.915561 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718ba1-2eb0-4278-a4dc-a09a0ac87c51 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:46.915856 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b718ba1-2eb0-4278-a4dc-a09a0ac87c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:46.991506 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-4b718ba1-2eb0-4278-a4dc-a09a0ac87c51 None None] MFA Rules not processed for user `9cd9f8c45f0743579418354966a74ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:46.992637 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-4b718ba1-2eb0-4278-a4dc-a09a0ac87c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:47.013419 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:47.069098 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 581/1151] 10.222.0.27 () {58 vars in 1059 bytes} [Wed Oct 12 14:33:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:47.076745 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:47.078312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:47.180719 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af0540-98f3-426d-8094-b9edbdaea908 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:47.253819 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd9f8c45f0743579418354966a74ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:47.254365 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:47.254641 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:47.254905 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:47.257026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:47.310079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:47.365367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:47.366858 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c45a-8153-4777-8d19-7e8425b1464c service glance] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:47.386888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 571/1152] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:49.648552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:49.649143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:49.649143 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:49.650498 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 582/1153] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:49.655792 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4457-eee6-44b5-8ee6-cc4d971751f7 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:49.656238 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4457-eee6-44b5-8ee6-cc4d971751f7 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:49.656397 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff4457-eee6-44b5-8ee6-cc4d971751f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:49.721777 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-96ff4457-eee6-44b5-8ee6-cc4d971751f7 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:49.722912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-96ff4457-eee6-44b5-8ee6-cc4d971751f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:49.819229 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 572/1154] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:50.095615 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:50.097155 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:50.222710 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5ffd8-c225-486f-8f26-6e078f8a46a6 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:50.272436 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:50.316253 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:50.316857 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:50.317133 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:50.317402 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:50.318663 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:50.319760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:33:50.319760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:33:50.319760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:33:50.320892 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8fd47-2c30-4e5d-a427-5844f0a4ddb9 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:50.339525 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 583/1155] 10.222.0.27 () {56 vars in 1108 bytes} [Wed Oct 12 14:33:50 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:33:52.495119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:52.495683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:52.495683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:52.496999 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 573/1156] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:52.502478 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaca1-4445-401e-a6ad-e6691b66bfc2 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:52.502894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaca1-4445-401e-a6ad-e6691b66bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:52.503006 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afaaca1-4445-401e-a6ad-e6691b66bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:52.568401 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7afaaca1-4445-401e-a6ad-e6691b66bfc2 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:52.569596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7afaaca1-4445-401e-a6ad-e6691b66bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:52.664106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 584/1157] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:52.960965 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:52.962501 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:52.972263 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:53.108243 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbcc90-82bd-4b6d-b031-1028a43c21d8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:53.186834 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:53.219248 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ae307c1cb064d0cb4b8b61cc5fe13d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:53.219784 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:53.220060 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:53.220332 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:53.221914 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:53.312029 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:53.313631 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2277ee8-ad36-458c-af49-08cd9dd3126d service nova] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:53.331270 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 574/1158] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:55.658078 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:55.658687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:55.658687 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:55.660043 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 585/1159] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:55.666312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709952-6984-4d3e-ad34-3461b129a278 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:55.666736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709952-6984-4d3e-ad34-3461b129a278 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:55.666840 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed709952-6984-4d3e-ad34-3461b129a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:55.733683 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-ed709952-6984-4d3e-ad34-3461b129a278 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:55.734847 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-ed709952-6984-4d3e-ad34-3461b129a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:55.780401 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:55.831223 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 575/1160] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:56.117428 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:56.119012 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:56.142139 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:56.220796 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ec678-e6bb-46a8-8841-273678ba135f None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:56.293760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:56.294323 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:56.294603 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:56.294874 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:56.296433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:56.368858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:56.404017 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:56.405460 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9d4fa-3fe6-48b0-b727-01f79a77eba4 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:56.426492 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 586/1161] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:33:58.601651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:58.602245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:58.602245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:58.603552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 576/1162] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:33:58.608791 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284af47-84b2-4814-a80a-b3961f937d94 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:58.609184 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284af47-84b2-4814-a80a-b3961f937d94 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:58.609339 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284af47-84b2-4814-a80a-b3961f937d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:58.674068 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-e284af47-84b2-4814-a80a-b3961f937d94 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:33:58.675292 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e284af47-84b2-4814-a80a-b3961f937d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:58.769568 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 587/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:33:59.057868 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:33:59.059476 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:59.160478 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf3f20-a74b-46a6-972a-ff86833c9882 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:33:59.234075 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:33:59.235591 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:33:59.236364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:33:59.236825 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:33:59.237144 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:33:59.239129 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:33:59.347016 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:33:59.348473 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33401524-d5d6-448b-9c80-d3df10288674 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:33:59.366651 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 577/1164] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:34:01.691467 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:01.692055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:01.692055 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:01.693973 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 588/1165] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:34:01.699250 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247000cc-1819-446b-a201-b1ab2f6922bb None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:01.699676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247000cc-1819-446b-a201-b1ab2f6922bb None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:01.699798 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247000cc-1819-446b-a201-b1ab2f6922bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:01.765888 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-247000cc-1819-446b-a201-b1ab2f6922bb None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:34:01.767079 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-247000cc-1819-446b-a201-b1ab2f6922bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:01.821458 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:34:01.865391 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 578/1166] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:34:02.164597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:34:02.166131 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:02.204227 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:34:02.271303 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b9bd6-dcbe-42db-8d48-c0406a8051c4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:34:02.343293 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:34:02.343894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:02.344174 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:02.344443 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:02.346068 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:02.424771 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:34:02.453070 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:34:02.454759 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1423-214c-40ed-b15b-c0780f3794a5 service neutron] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:34:02.472694 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 589/1167] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:34:04.795374 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:04.795956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:04.795956 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:04.797260 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 579/1168] 10.222.0.27 () {54 vars in 927 bytes} [Wed Oct 12 14:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:34:04.802444 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04654-6811-4afb-8eea-b41539c2a6d9 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:04.802880 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04654-6811-4afb-8eea-b41539c2a6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:04.802984 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04654-6811-4afb-8eea-b41539c2a6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:04.869372 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-76d04654-6811-4afb-8eea-b41539c2a6d9 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:34:04.870596 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-76d04654-6811-4afb-8eea-b41539c2a6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:04.965500 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 590/1169] 10.222.0.27 () {58 vars in 1024 bytes} [Wed Oct 12 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:34:05.251565 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:34:05.253125 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:05.355138 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2025f5-52bc-432b-ac9b-c404d13bdf5f None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:34:05.426644 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:34:05.427746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:34:05.428021 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:34:05.428284 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:34:05.429851 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:34:05.438209 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:34:05.537380 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:34:05.539033 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e22a21-e931-42fa-9c12-40461779e7c0 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:34:05.558939 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 580/1170] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:34:14.964020 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=82 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:34:15.556626 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=50 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:24.110251 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:24.110792 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:24.110792 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:24.186228 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:35:24.187424 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:24.281127 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 591/1171] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 12 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:35:24.289857 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:24.290371 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:24.290484 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:24.365325 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.auth.core [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81562) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:35:24.366558 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:24.460700 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 581/1172] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 12 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:35:24.465332 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:24.466561 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:24.477760 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a4910-5c8f-4ae6-9dd3-7f72e7e8414d None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:24.538223 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:24.570843 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:24.571433 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:24.571706 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:24.571972 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] PATH_INFO: `/v3/domains` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:24.572597 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81561) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 14:35:24.572894 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:24.573889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:35:24.573889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:35:24.573889 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:35:24.574810 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:24.586989 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 592/1173] 10.222.0.27 () {58 vars in 1153 bytes} [Wed Oct 12 14:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 14:35:24.596370 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:24.605552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71dad6-f829-4fc8-84da-d11d027cfbf8 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:24.668736 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:24.702889 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:24.703493 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] REQUEST_METHOD: `POST` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:24.703768 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:24.704036 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:24.704653 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:24.705756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:35:24.705756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 12 14:35:24.705756 dv-cinder-812685-17-smb devstack@keystone.service[81562]: Oct 12 14:35:24.707004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:24.761579 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 582/1174] 10.222.0.27 () {60 vars in 1153 bytes} [Wed Oct 12 14:35:24 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:35:24.765850 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:24.767451 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:24.801755 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b249a9-3c25-4b55-8f24-000b369c1ada admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:24.893218 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:24.893859 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:24.894135 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:24.894436 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] PATH_INFO: `/v3/users` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:24.895053 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:24.896047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:35:24.896047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:35:24.896047 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:35:24.897252 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:24.938617 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 593/1175] 10.222.0.27 () {60 vars in 1144 bytes} [Wed Oct 12 14:35:24 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 14:35:24.943304 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:24.944802 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.006217 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd748808-b5f7-4b18-a9f8-1fca2f942799 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:25.087912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:25.099659 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:25.100245 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.100516 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.100782 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.101409 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:25.103033 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:25.115771 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 583/1176] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 12 14:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:35:25.119822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:25.121334 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.132695 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5882995-2cd1-46de-bd6a-ebf53329073b admin admin] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:25.157553 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:25.227544 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:25.228146 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.228423 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.228693 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.229322 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:25.230959 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e0065-bc39-4242-9b04-9b93b32dd660 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:25.242941 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 594/1177] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 12 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 14:35:25.247262 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:25.248775 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.282318 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a560-35a7-4b3d-9848-39e73816a48d admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:25.376140 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:25.376785 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.376981 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.377246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] PATH_INFO: `/v3/projects/dd55bdd5a6334e3cafc1487514762cba/users/5eec44cf6cef4861a660073f9798dc8c/roles/0758c64a8e384ccda9eb5443f4a87c6b` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.400224 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd55bdd5a6334e3cafc1487514762cba, user_id=5eec44cf6cef4861a660073f9798dc8c, role_id=0758c64a8e384ccda9eb5443f4a87c6b)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:25.402903 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5294bc7-506c-4ed4-83e3-e0cd4dcb64c5 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:25.427980 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 584/1178] 10.222.0.27 () {60 vars in 1483 bytes} [Wed Oct 12 14:35:25 2022] PUT /identity/v3/projects/dd55bdd5a6334e3cafc1487514762cba/users/5eec44cf6cef4861a660073f9798dc8c/roles/0758c64a8e384ccda9eb5443f4a87c6b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:35:25.438852 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb2ee8-d6b6-4961-81e2-a299d005edbc None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.439136 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb2ee8-d6b6-4961-81e2-a299d005edbc None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.439407 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb2ee8-d6b6-4961-81e2-a299d005edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.496106 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-0bfb2ee8-d6b6-4961-81e2-a299d005edbc None None] MFA Rules not processed for user `5eec44cf6cef4861a660073f9798dc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:35:25.497299 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-0bfb2ee8-d6b6-4961-81e2-a299d005edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.572872 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 595/1179] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 12 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:35:25.586052 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8165-7689-4156-a885-5859267d23c4 None None] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.586364 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8165-7689-4156-a885-5859267d23c4 None None] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.586637 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d8165-7689-4156-a885-5859267d23c4 None None] PATH_INFO: `/` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.587958 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 585/1180] 10.222.0.27 () {54 vars in 963 bytes} [Wed Oct 12 14:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:35:25.592822 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dd3b-131d-45d8-8b4c-d0cc8c9e0dac None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.593108 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dd3b-131d-45d8-8b4c-d0cc8c9e0dac None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.593384 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dd3b-131d-45d8-8b4c-d0cc8c9e0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.624358 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:25.668875 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-7c30dd3b-131d-45d8-8b4c-d0cc8c9e0dac None None] MFA Rules not processed for user `fd11abedcea148cd863b25261a0b37e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:35:25.670015 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-7c30dd3b-131d-45d8-8b4c-d0cc8c9e0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.743858 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 596/1181] 10.222.0.27 () {58 vars in 1060 bytes} [Wed Oct 12 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:35:25.751552 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8165-7689-4156-a885-5859267d23c4 None None] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:25.753663 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-000d8165-7689-4156-a885-5859267d23c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:25.803143 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:25.857004 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d8165-7689-4156-a885-5859267d23c4 None None] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:25.929676 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd11abedcea148cd863b25261a0b37e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:25.930246 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:25.930523 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:25.930793 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:25.932367 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:26.032450 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:26.033912 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:26.037893 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:26.053647 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 586/1182] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:35:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:35:26.098408 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f50c-a5a2-4c0e-b306-38f16180ce95 None None] REQUEST_METHOD: `GET` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:26.098701 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f50c-a5a2-4c0e-b306-38f16180ce95 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:26.098977 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849f50c-a5a2-4c0e-b306-38f16180ce95 None None] PATH_INFO: `/` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:26.100238 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 597/1183] 10.222.0.27 () {52 vars in 830 bytes} [Wed Oct 12 14:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 14:35:26.103791 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:26.104997 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:26.204992 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61907b9f-ae27-4575-9d56-e3db97620f55 service cinder] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:26.298110 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:26.298803 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:26.299080 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:26.299349 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] PATH_INFO: `/v3/users/5eec44cf6cef4861a660073f9798dc8c` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:26.312465 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eec44cf6cef4861a660073f9798dc8c)` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:26.313497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: WARNING py.warnings [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:35:26.313497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: warnings.warn(msg) Oct 12 14:35:26.313497 dv-cinder-812685-17-smb devstack@keystone.service[81562]: Oct 12 14:35:26.314740 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:26.324921 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=100 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:26.380746 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eec44cf6cef4861a660073f9798dc8c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:26.381356 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eec44cf6cef4861a660073f9798dc8c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:26.395198 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eec44cf6cef4861a660073f9798dc8c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:26.418161 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eec44cf6cef4861a660073f9798dc8c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:26.428099 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.notifications [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eec44cf6cef4861a660073f9798dc8c'} {{(pid=81562) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:26.434119 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 587/1184] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 12 14:35:26 2022] DELETE /identity/v3/users/5eec44cf6cef4861a660073f9798dc8c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:35:26.438552 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] REQUEST_METHOD: `POST` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:26.439030 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:26.439148 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:26.496387 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.auth.core [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] MFA Rules not processed for user `21c3be1e2cd1482e97fd97e6bb74d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81561) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 14:35:26.497522 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:26.571480 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=100 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:26.585266 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 598/1185] 10.222.0.27 () {58 vars in 958 bytes} [Wed Oct 12 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 14:35:26.595046 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Authenticating user token {{(pid=81562) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:26.596276 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:26.696078 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fb9bc-e82a-4b70-b55b-f8dd406570a6 admin admin] Validating token access rules against request {{(pid=81562) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:26.749538 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:26.770695 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1342faa2ddc741ad9f0f5122041b209b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '732d5898e7be4bcc948bdf59ffa4dc68', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81562) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:26.771312 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:26.771620 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:26.771895 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81562) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:26.773496 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.fernet_utils [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81562) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:26.882269 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:26.883728 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cbb8b-f0c8-48f5-b11d-ed1a72bd63c1 service neutron] RBAC: Authorization granted {{(pid=81562) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:26.902128 dv-cinder-812685-17-smb devstack@keystone.service[81562]: [pid: 81562|app: 0|req: 588/1186] 10.222.0.27 () {60 vars in 1365 bytes} [Wed Oct 12 14:35:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 14:35:27.221034 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] Authenticating user token {{(pid=81561) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 14:35:27.222314 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.fernet_utils [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81561) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 14:35:27.233472 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9c4b2-018d-4096-b73a-9418eb33e6a4 None None] Validating token access rules against request {{(pid=81561) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 14:35:27.332618 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21c3be1e2cd1482e97fd97e6bb74d37f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12a7cca3f1ca479292dd1f33c68bdb7c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81561) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 14:35:27.333188 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 14:35:27.333464 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 14:35:27.333731 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] PATH_INFO: `/v3/projects/dd55bdd5a6334e3cafc1487514762cba` {{(pid=81561) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 14:35:27.343535 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd55bdd5a6334e3cafc1487514762cba)` {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 14:35:27.344556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: WARNING py.warnings [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 14:35:27.344556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: warnings.warn(msg) Oct 12 14:35:27.344556 dv-cinder-812685-17-smb devstack@keystone.service[81561]: Oct 12 14:35:27.345745 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] RBAC: Authorization granted {{(pid=81561) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 14:35:27.403684 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd55bdd5a6334e3cafc1487514762cba', 'request_id': 'req-4421b76f-5234-4895-b743-ce602788f288'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:27.418541 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd55bdd5a6334e3cafc1487514762cba', 'request_id': 'req-4421b76f-5234-4895-b743-ce602788f288'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:27.428486 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd55bdd5a6334e3cafc1487514762cba', 'request_id': 'req-4421b76f-5234-4895-b743-ce602788f288'} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:27.451310 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] The token cache is being invalidate because project dd55bdd5a6334e3cafc1487514762cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81561) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 14:35:27.451911 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:27.452017 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG keystone.notifications [None req-4421b76f-5234-4895-b743-ce602788f288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81561) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 14:35:27.453364 dv-cinder-812685-17-smb devstack@keystone.service[81561]: [pid: 81561|app: 0|req: 599/1187] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 12 14:35:27 2022] DELETE /identity/v3/projects/dd55bdd5a6334e3cafc1487514762cba => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 14:35:36.900026 dv-cinder-812685-17-smb devstack@keystone.service[81562]: DEBUG dbcounter [-] [81562] Writing DB stats keystone:SELECT=62 {{(pid=81562) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 14:35:37.449263 dv-cinder-812685-17-smb devstack@keystone.service[81561]: DEBUG dbcounter [-] [81561] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}